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PREFACE 



Rand is coIlductln^^ under the sponsorship oC the U.S. Ofiice of Education, a 
several-year study of federally funded programs designed to introduce and spread 
innovative practices in pubhc schools. These change agent programs normally offer* 
temporary federal funding to school districts as "'seed money/' If an innovation is 
successful, it is assumed that the district will continue and disseminate part or all 
of the project using other sources of funds The Rand study examines four such 
fede! al change agent programs— Elementary and Secondary Education Act Title III, 
innovative Projects. Elementary and Secondary Elducation Act Title VII. Bilingual 
Projects. Vocational Education Act, 1968 Amendments. Part D, Exemplary Pro- 
grams, and the Right-To-Read Program. The study identifies what tends to promote 
various kinds of changes in the schools and what doesn't: in particular, the Rand 
study will identify for federal, state, and local policymakers the nature, permanence, 
and extent of dissemination of innovations that are associated with the various 
federal programs and with various federal, state, and local practices. 

This report is the third in a series that describes the first-year results of the 
Rand study (July 1973-July 1974). It summarizes the findings and policy implica- 
tions resulting from 29 case studies of change agent projects conducted by Rand staT 
members and consultants in 25 school districts during April and May 1974. The ca.se 
study .sites, chosen from the original sample of 293 projects in 18 states initially 
surveyed, represent a variety of project objectives and local district conditions. This 
report also describes the role of the state education agencies in selecting, managing, 
and disseminating change agent projects. 

Four technical appendixes to this volume describe in detail the federal program 
management approach, state education agency participation, and case studies for 
each of the programs in the study: Title III, App. A; Reading. App. B; Bilingual 
Education, App. C, and Career Education. App. D. Appendix A should be of particu- 
lar interest to researchers or practitioners concerned with the introduction of new 
approaches to classroom instruction. 

Volume I of the series (R-1589/M-IEW, A Model of Educational Change) pro- 
vides a theoretical perspective for the Rand study by analyzing the current state of 
knowledge of planned change in education and by proposing a conceptual model of 
factors affecting change processes within school districts.* 

Volume II (R-1589/2-HEW. Favtom AtTeriin^ Chan^p AfrerU Projects) contains 
the analysis of survey data collected from a natio»^jl sample of 293 projects in 18 
states during November and December 1973 

Volume IV iR-1589/4-HEW, The Findin^iy in Review) summarizes the findings 
of Vols, I, II. and IIL and also synthesizes extensive data collected by Rand on 
federal-level program strategy and management for each of the change agent pro- 
jects; Volume IV also includes a discussion of* alternative federal strategies for 
promoting innovation 

l^r(<m-<M)f Harul's ,nt<'r<-t jm .uhaiKnm knox^lfduc of oru MJiAition^j! behavior in oducalional iMhtJ- 
tunons. i\w tt'MMu-h iim\vihm^ this f,>porl ^a- -upixM'ted in \mil b> an alhnatmn of Kami coi potato 
research lui)<l> \ 
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\'olume y iIM589< 5-IlP]W, ExemUiv Summuryi presents the study's methods 
and results for a genc^ral audience. 

Subsequent research will collect additional data on Titles HI and V!I of ESEA, 
with particular focus on projects whose federal fundinj,^ has expired. 



SUMMARY 



Under the sponsorship of the U S. Oflice of Education. Rand has been conduct- 
ing' a study of* federally funded programs designed to introduce and spread innova- 
tive practices in public schools. These change agent programs normally offer tempo- 
rary federal funding to school districts as seed money. If an innovation is successful. 
It IS assumed that the district will continue part or all of it using some other source 
offundsand it will be disseminated to other districts who are interested in replicat- 
ing it. 

The Rand study examines four such federal change agent programs -Elemen- 
tary and Secondary Education Act Title HI. Innovative I^'ojects: Elementary and 
S(»condary Education Act Title VII. Bilingual Projects; Vocational Educjrtion Act, 
19^8 AmendmeiUs. Part D. Exemplary Programs; and the Right-To-Read Program. 

A major objective of this change agent study has been to describe the institu- 
tional and educational processes which appear to affect the success of innQvative 
education projects. This report synthesizes the findings from 29 exploratory case 
studies of such projects, performed in paraHel with a nationwide survey of 293 
change agent projects that were in their last or next to last year of funding during 
the 1973-1974 school year. 



SAMPLE SELECTION 

The case study sites were selected to include a suflicient number of projects from 
each federal change agent program so that we could assess the effects of* different 
federal policies, while providing, insofar as possible, a diversity of demographic and 
institAitional settings. Further, because the fieldwork was exploratory, we oversam- 
pled on reported "project success." and attempted 'to include those projects that 
seemed able to provide rich data on the change process. Our project selection was 
based on data from a preliminary analysis of the survey data, from screening inter- 
views with candidate LEAs. and from a review of project abstracts and evaluations 

In order to minimize the degree of variability that each field observer would 
have to deal with, we limited our selection of case studies to five types of innovations: 
career education, bilingual education, reading, staff development, and classroom 
organization. The first three types are tho.se supported by the Vocational Elducation. 
Title VII. and Right-To-Read programs, respectively. The last two represent particu- 
lar types of Titie III projects we decided to focus on because they were trying to bring 
about significant and wide-ranging change. 

Our five groups of projects varied in complexity depending on the curriculum 
area and target group fbcu.s. or on the type of behavioral change they were attempt- 
ing to produce. 

The career education projects, which primarily involved the development and 
introduction of new curriculum materials, field trips, counseling, and work experi- 
ence programs, weiv the U^ast c(;mplex of our .sample No significant classroom 
changes were usually required, other than the coverage of* new curriculum materi- 
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als In only one case did the career education project provide a framework (or 
in^titutuiL,^ fundamental reform^. None of our i>aniple districts appeared wiliing to 
pick up the coi?ts of project funding after the out.^ide grants expwed. 

The bilingual proj(»cti- were somew hat more complex, they attempted to deal in 
a no\el \\a\ witli the learning problems cf a particular target group. Some of them 
attempted to use open classrooms or other nontraditional methods of conducting 
classes The> also created new demands on LEA administrators by making them 
recognize a potent new community interest group. 

Tlie reading projects, although confined to a single well-specified curriculum 
area, sonietimes sought to achieve considerable change in instructional technique. 
All of our sites were urban districts w hich were supposed to be implementing some 
form of "complete reading program'' based on the diagnostic/prescriptive method 
of instruction. Actually, several of the sites used their funding for much more 
limited purposes or to support activities that were only tangentially related to 
reading instruction. 

Tlie staff development projects were a more comprehensive attempt to improve 
teacher effectiveness— primarily through a program of in-service workshops and 
classroom technical assistance designed to confront participants with the limita- 
tions of traditional methods and todemonstrate the valueof new behavioral change, 
techniques. In some cases this training effort was coupled with some specific plan 
for modifications in the LEA s instructional program. 

The classroom organization projects were tlie most complex attempt at change 
we observed. Three of the projects focused on strategies of informal education: 
mult iage grouping, open education, and integratt*d curriculum. One involved team 
teaching and differentiated staffing, while another involved an alternative school — a 
street academy. 



STUDY APPROACH 

Kach of the case studies was carried out by one or two researchers vi.siting the 
project site for several days to interview project participants and other district 
personnel, and to observe the educational program in both project and nonproject 
cla.ssrooms. From these interviews and observations, we drew inferences and made 
judgments about the factors that It^ to the initiation of the project, the quality of 
its implementation, and the impact it has had. 

In organizing our report, we have chosen to characterize the process of innova- 
tion in three phases: initiation, implementation, and outcomes.* 

Initiation includes identifying a need or opportunity for a particular project and 
.specifying a strategy for carrying it out. It includes generating local support for the 
project s objectives, cfioosing a project strategy, and trying to get funds. 

Implementation consists of making the project function in the local setting. It 
includes administration, training, materials development, planning, and evalua- 
tion, as well as all the decisions necessary to adapt the project and the local institu- 
tions at the site to each others requirements. 

The project outcomes are the effects — long- and short-term, direct or indirect — 
that a project lias on the adopting district. These outcomes can include student 

* vScc Vol I (or theoroticul fiamework support irm this or^am/ation 
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pcflormatice. clasMoom atniospluTc. leacluT behavior, or im|)acl on the district's 
program Tlicir persislente or loii^'-lerm unpad is aflecled by the degree to winch 
project techniques are continued afler the federal K'nuits are ended and disseminat- 
ed to other schools or districts. 



INITIATION 

Initiation of most i)roject^ was motivated by either fiscal opportunism (a chance 
to obtain additional Cundsi or interest m fiiliillinf; a specific local need. We did not 
(iiul districts taking an R&D or experimental approach to innovation Those projects 
that represented opportunity-babed behavior generally lacked the commitment and 
>upport of the local administration and failed to result in significant change. Pro- 
jects initiated in response to a local need, on the other hand., usually were strongly 
supported bv the district, giving the project status in the eyes of participants and 
lesulting in instances of significant change. ALso. projects that addressed goals 
related to important district concerns were more likely to result in change than 
those that addressed less central local or federal concerns. 

Most projects were based on information or treatments that were already 
known locally rather than using information derived from a search for alternatives 
[f staff members who were expected to implement the project were allowed to 
participate in the development stages, then there were usually fewer implementa- 
tion problems, while projects that were designed by "outside experts" generally 
failed to gather support or achieve their objectives. 



IMPLEMENTATION 

Implementation occurs when the project plans confront reality— when partici- 
panf. attempt to carry out the proposed innovative strategy. As hypothesised in our 
review of literature on educational innovation (Vol. I), we found that implementa- 
tion was essentially an organizational process of mutual adaptation between the 
project design and the institutional setting, and that implementation strategies had 
a significant effect on the project outcomes Implementation was most successful 
when based on strategies that fostered mutual adaptation and permitted it to take 
place, specifically: on-line planning efforts and continuing reassessment of project 
methods- provision of extensive pre-service and in-.service training for all partici- 
pants- frequent, regular meetings of project personnel to discuss problems and share 
ideas- and the local development of project materials, as opposed to the utilization 
of commercially prepared packages. This latter activity provided an opportunity to 
■'learn by doing" as \/ell as a sense of identification with the projects goals and 
understanding of its precepts. 

h motivating participants, intangible professional and psychological incentives 
were more significant than tangible incentives such as extra pay or credit on the 
district's salary scale, although the latter types of rewards were frequently used 

Klementary school projects were more successful than junior or senior high 
v^diool projects AI.<o. districts with prior innovation experience were less likely '"o 
have implementation problems than those le.ss experienced. But the exi.stence of 
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Mineral innovative pio)ecl5> m a ^\n^\v dLslrict oIUmi detracted iVom the attention 
paid a ^iven project, and thus from its chance.^ of success 

Other factortj leading to more successful implementation incktded. the exis- 
tence of'a critical mass of" participants in any given school \slio could provide each 
other with mutual support, strong administrative sup[)ort from all levels of" the 
s>^tem. A flexible administrative appioach to unexpected contingencies, and class- 
room technical assistance to complement training or materials development compo- 
nents. 



PROJECT OUTCOMES 

The project outcomes of inteiest to this study were: the eflects of the project on 
classrooms, teachers, and students, the extent to which the project treatments were 
continued after the special project funding ended, and the amount of dissemin tion 
which took place between the project schools and nonproject schools, both within the 
LEA and to other districts. 

Although most of the projects we observed did lead to noticeable changes in 
project classrooms, the staffdevelopment and classroom organization projects had 
more effect on the atmosphere and activities of the classroom than did the more 
narrow ly focused projects. These effects were most apparent in the lower grades. The 
classroom organization and staffdevelopment projects also resulted in the most 
significant and pervasive changes in teacher behavior and attitudes. When changes 
were made in only one part of the curriculum, such as reading or career education, 
these changes seldom affected other subjects, even when they were taught by the 
same teacher. 

Although few, if any. of the projects which had completed evaluation studies 
could demonstrate significant gains in student achievement, some projects, particu- 
larly those involving classroom reorganization, did report improvements in student 
attendance, school-related attitudes, self-control, and confidence. 

Our fieldwork provided some evidence that project continuation decisions are 
not made on project merits alone. In particular, formal evaluation seemed to have 
very little effect on the continuation choice. The initial commitment of the LKA 
administrators to the project appeared to be the dominant single factor. 

We also found that projects which replaced existing practices were more likely 
to continue than those which merely supplemented the existing curriculum. Other 
Victors which appeared to raise the likelihood of project continuation were: an 
emphasis on training rather than the introduction of new technology; training 
focused on practical classroom issues rather than theoretical concepts, local develop- 
ment and direction rather than reliance on outside consultants. 

Only a few projects were actively engaged in dissemination activities. We ob- 
served very little evidence of "lighthouse" effects even within the host district This 
was primarily due to lack of interest from nonproject schools rather than to lack of 
visibility for the exemplary projects. The most productive dissemination efforts 
appeared to occur where the disseminator was helping other schools or districts 
build up their innovative capabilities vather than attempting to replicate a specific 
model ^ 
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FEDERAL AND STATE PROGRAM MANAGEMENT 
STRATEGIES 

State education agencies |)laye(l an active role only in the state portions of'Title 
111 (85 [)ercent ol'the funds} and Vocational Education (50 percent). In al! ofthe other 
programs, the states sho.v'ed little interest in the federally funded sites within their 
jurisdiction The only exception was that some states with their own active bilingual 
()rograins attempted to assist or benefit from the federally sponsored projects 

Project selection |)rocedures ran from open competition w^ith a minimum of 
political interference under state Title HI. to straightforward nomination proce- 
dures based on LEAcharacteristics. as in the Right-To-Read demonstration projects 
The competitively generated projects evidenced a much greater degree of LEA 
coiiuiiitment. probably because the competition itself required hard wwk by the 
applicants and because the selection boards' renewal procedures kept up the pres- 
sure on districts to perform. 

Project monitoring ran from fairly strong under state Title HI to nonexistent 
for the Right-To-Read demonstration projects or federal Title III. Projects supported 
by these latter progiams diverged from their initial objectives more frequently than 
did the other programs. Most LEAs seemed quite perceptive about the degree of 
freedom they had. 

Only m a few ofthe state Title HI projects did the formal project evaluations 
seem to have any operational effect, and then largely at the personal insistence of 
the project monitor. P'or many ofthe other projects, the funding agency collected no 
useful feedback concerning project results, nor did the LEAs appear to use evalua- 
tion evidence. Termination or redirection of projects because of poor results ap- 
peared to be extremely rare 

In general, the states played a passive role in disseminating project results, 
leaving this up to the sponsoring LEA. Only a f*ew states had a formal procedure for 
screening projects and disseminating the best of them. 
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1. INTRODUCTION 



This vohimi' analv/.ob tlie process of change that charactei-ix.es innovations at- 
teniptecl by school districts using federal funds. The analysis, which is based upon 
lield studies ()l"29 change agent projects, is one component of a Rand study sponsored 
In- the U.S. Oliice of Education 



BACKGROUND OF THE CHANGE AGENT STUDY 

During the 1950s and 1960s, two important initiatives, the National Defense 
Education Act of 1958 and the Elementary and Secondary Education Act of 1965, 
defined a new federal role in local education— large-scale support of federally man- 
dated programs aimed at specified goals: subsidizing special curriculum develop- 
ments, educating the disadvantaged, training young people for careers, broadenmg 
access to higher education, and encouraging innovation in the public schools, which 
is the subject of this study. Approximately 10 percent of the.federal aid to public 
schools, currently exceeding S3.5 billion annually, is aimed at promoting education- 
al innovations. These funds.are spent, primarily by the U.S. Office of Education, 
through a number of avenues and with diverse strategies, including the so-called 
' change agent programs analyzed in this study:' Elementary and Secondary Educa- 
tion Act Title in. Innovative Projects t$150 million annually); Elementary and 
Secondary Educo'=on Act Title*'VII, Bilingual Projects ($45 million);- Vocational 
Education Act, lt> 8 Amendments, Part D, Exemplary Programs ($16 million); and 

Right-To-Read (S12 million). 

Each change agent program has a distinct focus and management strategy. The ' 

largest of the programs considered here. Title III, is designed to improve the quality 
of public education both by introducing model practices that are new to American 
education and by spreading existing successful practices to schools that are not 
aware of them: The competition for Title III grants of three-year duration is open 
to almost any kind of project that local schools wish to propose. In 1973-1974, the 
firs* year of our study, 15 percent of Title JH money was granted directly to local 
educational agencies (LEAs) by the Office of Education, and the remaining was 
allocated to state educational agencies (SEAs), who in turn made grants to LEAs. 
Other federal change agent programs are more narrowly targeted and have more 
specific funding criteria. Right-To-Read represents an "attempt by the Office' of Edu- 
cation to create a national educational priority for reading, particularly for disad- 
vantaged students. The Right-To-Read demonstration projects, the program compo- 
nent addressed in this study, included a prescribed planning and management 
strategy in an effort to facilitate effective implementation. Vocational Education,. 
Part d! was designed to create exemplary programs to enhance career awareness 
and readiness. Congress, believing that many SEAs were not able to promote signifi- 

' OtluM ti'diM-al proutiims. not Mudied \wn: also aim at iMicouraMint; innovatioiih-f n , ciTtaiii pio- 
H,an.,s l„r hand.c.-.ppi'd ^.tudent.s. ..M)e-.nnc.ital .v.hools .■ducational vouduT dcinonbtraUo.i^, hollow 
Tliiounh. i'kMm>iit.< of tlie KnuTMi-ney School Ahsihtancf Aot 

1 
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cant iiUKAationb. ^a\e L'SOE ihv autlu)nt> to Cund local piojocts diivctlv through 
tlio Part n [)ro^raiH Ilah'oCtho Part D a(>propnatlo^^^ are allotted to tlie SKA^^. the 
otlier hall to USOK Title (HiliiiKual Kducation) oritiinall\ ijOUi^lit to [)ro\ide 
model [)rojects (o! the ^^peclal need.s oC children uho?>e l^^Kli^^h-^^peaki^^ ability was 
limited Tlie pro^M*ani lla^^ ^^ubi!^ei^uentl> also de\elo[)ed into an edbrt to maintain and 
encourage "cultural pluralism" in Ameiican public education, uitli strong political 
siipport (rom many people oC Spanish-language origin. 

Despite these differences in (bcus and management strategy, the change agent 
programs have a common purpose, the stimulation and spread oCeducational inno- 
vations They also have a common policy instrument, the provision oC temporary 
funds (3-5 years!, which, though small relative to the budget oC a scliool district 
'langing (rom grants of ten tliousand dollars or less to several hundred tliousand 
dollars per year>. are intended to fund new educational services, not to support 
existing practice These programs also rest on common assumptions. They all as- 
sume more or less -explicitly that American education should be doing better in 
respect to a variety ofgoals ranging from specific objectives such as student reading 
acliievement to the broad concerns of student personality and social development. 
^ Moreover, the change agent programs assume that educational practices, proce- 

dures, and methods can be improved within the existing educational structure. 
Federal policy ^.presumes that providing funds to a relatively small number of dis- 
tricts to try innovations will demonstrate the value of some of these innovations 
which will then be adopted selectively by other districts. 

Numerous studies have evaluated, described, or analyzed innovative projects 
and federal programs designed to stimulate educational change." These studie.: are 
mixed both in their research quality and in their findings. Anecdotal and single-case 
study evaluations usually claim considerable 'success" (or projects supported by 
federal funds. Yet quantitative evidence and careful (ieldwork suggest something 
quite diderent: 

♦ Variations in student outcomes have not been con.sistently related to 
variations in treatments, once nonschoo! factors are held constant. 

• "SuccessfuT' projects have lacked stability and have not been easy to "ex- 
' port ' from school to school or district to district. 

The alleged ineffectivene.ss and instability of innovative projects might bedismissed 
either as premature— it may indeed be too soon to judge innovations that take many 
years to develop — or as subject to measuring the wrong student outcomes in the 
wrong ways— profound measurement problems surely plague assessments in this 
field. Hov\ever. it is more prudent to assume that present policies and the assump- 
tions underlying them need to be reexamined and, where appropriate, revised and 
redirected. With these objectives in mind. USOE asked Rand to undertake a several- 
year study to examine innovative projects funded by the various change agent 
programs.' and. in particular, to treat the following questions* 

1 How should the degree, quality, and extent of innovation and dissemina- 
tion of change in the public schools be assessed? 

' hi this ivixnt. uc nHvr to pnt^tum^ wUvn (IrMTihin^ ihv U'dcral ch iriKt* a^cnt mitiatucs. v . 
|{juhl To lU'tui \W' tvivi tu />;u/c</s whin (itvscnhjrit^he particiiLu innmatiun sdettt'd b\ a si.hu(>l 
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2 How do school districts select, introduce, im[)lement. incorporate, and 
spiead different kinds of innovations? 

:i How do difierences in target groups, resource use. educational treatment, 
project strategies, and other characteristics aflect the initiation, implemen- 
tation, persistence, and dissemination of innovations? 

4. How do differences in institutional and political contexts affect the initia- 
tion Jmplementation, persistence, and dissemination of* innovations? 

5 Hovv*. ifat alK'do differences in the relations among the characteristics of* 
mfiovations and the institutional-political setting aflect the initiation, im- 
plementation, persistence, and dissemination of innovations? 

6 ' Do the different federal change agent program strategies have different 

effects on the initiation,^ implementation, and outcomes of local projects? 

7 What should federal policies be toward educational innovation in light of 
the political, financial, and organizational constraints that the federal gov- 
ernment faces in its dealings with the public schools? 



CENTRAL PREMISES AND THEORETICAL FRAMEWORK 

In order to study the questions listed above, we developed a theoretical frame- 
work— a set of hypotheses and assumptions— that has guided the research. The 
framework rests on two assumptions: first, that there are distinctively different 
stages of'the innovative process and, second, that the, institutional setting profound- 
ly influences the nature and impacts of an educational innovation, as well as its 
likel> permanence and dissemination.* 

Stages of Innovation 

We view the change or innovative process a.-, consisting of three stages: initia- 
tion, implementation, and incorporation. The initiation stage in the life of an in- 
novative project occurs when local school officials conceive and formulate plans, seek 
resources, and make decisions about which projects they should select and support. 
We hypothesize that the support and commitments made in the initiation period 
affect what happens when project implementation begins. 

In the implementation stage, the project confronts the reality of its institutional 
setting, and project plans must he t ranslated into practice. Many innovative projects 
fail or are disappointing because they are not implemented according to plan. But 
the issue of implementation is often more subtle and complicated than mere fidelity 
to predesigned means for attaining specified educational goals. We hypothesize that 
as a consequence of the institutional characteristics of local school systems the 
implementation of those educational innovations that result in significant change 
intrinsically involves a proce.ss of meitual adaptation.^ Thus, the initial design of an 

• The theoretical framework ls ju^tjfjed and elaborated m Vol \ 

' Vol. 1 delnics an innovation as |)lan with a statement of'Koalh and means designed to ehanjje 
Mandaid behaviors, practices, or procedure.s Manv educational innovations tend to have abstract «oalh. 
to lack specificity ami claritv of meanh. and to have con.siderable uncertainty as to the relationship 
.between means and eiuK .^tich uncertaintv makes it desirable for the innovation to become deve!o()ed. 
revLsed. oi in ^bort. adapted to the realities of its in>titut umal setting' Accordingly, we deline implemen- 
tation a> \hv change process that occ rs when an innovative project impinges upon an organization 

16 
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inn()vali\e project bcvomos adapted to the [)arti('ulai orKaru/ation^j! setting of the 
K'hool. ola>Mooni. or other institutional host^. at the >aiue time, the or;j:ani/iition 
and Its meniherh a(la[)t to the demands ol the [)n)}ect Therefore. man\ educational 
innovations mav fail to have desirable efleets because tlu» i)U>ject is not adapted to 
the institutional setting or vice versa. 

The term "incorporation" is used to denote the final stage in innovation— when 
an innovative practice may lose its "special project" status and become part of'the 
routini/ed behavior of'the LEA. hicorporation represents the most serious conimit- 
nient on the part of'the district, as federal "seed money" is withdrawn and decisions 
must be made about not only u7ie^/icrbut also wlnii componcf. ^.sof'and on what sca/c 
a project should be continued within the district. We believ\-4his decision may 
involve more .than the success or fhilure of'the project during its trial period. Eco- 
nomic, political, and organizational pressures and constraints may pla\ major roles 
in determining the innovation's future. 

Not only do these three stages involve somewhat different activities and deci- 
sions, but the significance of'actors and issues also changes from one stage to anoth- 
er. Thus we believe that a key to designing and assessing federal, 'state, and local 
policv lies in understanding how the stages ofinnovation work in different locations, 
for different innovations, and for the various change agent programs. 

Factors Affecting "Ovvtcomes'' 

The change pr;)t:ess itself is important, but systematic analysis also should 
identify major fa,rtors affecting the "outcomes" or effects of innovations. The first 
research problefn is to select or devise suitable measures of outcomes. Since federal 
programs and local and state policies aim at improving the education of children, 
!ie most direct and natural measure of the effectiveness of an innovative project 
would be changes in behavior, attitudes, or test scores of students. However, for the 
purposes of the study, it was both premature and inappropriate to measure student 
outcomes. The innovations were generally new to the district and consequently 
require an extended period before their true effects can be assessed. Moreover, these 
projects differed considerably in their focus, goals, methods, and assessment proce- 
dures. Therefore, there was no practical way to compare, for example, outcomes of 
bilingual readuig projects with projects dealing with remedial mathematics." More 
important, mnovations may not be implemented according to plan. The first issue 
l)efore a.sses.sing longer-range student impacts is thui, to measure the effectiveness 
of tiie project s implementation. 

We studied three types of effectiveness measures or ^'outcomes": 

1 Implementation: (a) the relative extent to which project goals are 
achieved, (b) the type and extent of change in teacher behavior, and ic) the 
extent to which the project as proposed compares with the project as imple- 
mented. 

2. Conhniiation: the extent to which the project is continued by the I^EA 
after federal funds are withdrav/n. 

3. Disseminaiwn: the extent to which the project is diffu.sed to other schools 
in the district or to other districts. 

• Vol I of'thib Mud\ reviews the litcratuie on tho measurenierit of'sliidont oulconu's 



1 he ( lianm' agtMU studv consist^ of two ph.ase^. In phase one, which is covcrccl m 
ihe liiM \^)klme^ ol thi^ mm io. wo deal with projects thcil have not yet completed 
their period oriedera! Iiinding. con>eqiieiitly, the a^alyse^^ here are limited to im- 
pk-mentation oiita)me> and expected continuation (plus some preliminary informa- 
tion about dissemination'.' 

We believe that three interrelated sets ol* factors aficct these outcomes: 

• Characteristics of projects 

• Federal and state policies 

• Institutional settings 

Mom project evakiations investigate onl\ the relationship between outcomes arid 
the vdui'{i(iomtl teihuolo^v or method that is characteristic of the project. Yet two 
projects with the same educational method can be implemented in quite different 
wa\>, leading to different outcomes. This means that projects also can be character- 
ized by their implemenUitiou sfraic^^ics— that is, the design decisions about what 
should be .done to implement the project, how it should be done, and by whom. We 
hy[)Othe.Mze that implementation strategies will have major effects on project out- 
come^ 

Bec^l^e project evaluations usually are case studies of LEA projects funded by 
the sanu-federal change agent program, they tend to treat federal policy unsys- 
tematically This study examines four federal programs, each with a different aim 
and different management strategies This provides an opportunity to compare 
innf)\ative projects funded by different programs and an opportunity to assess the 
extent to which project outcomes are explained by differences between the federal 
programs. 

The most serious omission of most evaluation literature is its failure to take into 
account the institutional setting in which innovations operate. Such major elements 
of the institutional netting as demographic, economic, and political conditions of the 
district, community influences, student characteristics, and organizational char^ 
acteristics are usually neglected. Though the analysis wiW examine all relevant 
institutional elements wherever possible, the research design and analysis have 
been predicated on our belief that organizational characteristics of LEAs have major 
impacts on innovations and that federal, state, and local policies largely ignore the^e 
characteri.stics. 



OVERALL RESEARCH PLAN 

The theoretical framework thus suggests that two areas need to be studied if the 
broad questions implied by federal change agent policy are to be examined sys- 
tematically: first, the process of change and. second, the factors (namely, project 
cnaraeteristics. institutional betting, antl federal and state pohcies)affecting the in- 
novative project. Accordingly, the first phase of RancPs research efforts consisted 
of two principal data collecUon activities (Appendix .\ to Vol. IV provides a more 
d(4ail(Hi description of the overall study design): 

Thr fodrrai VcvaOonal Kduration projertN (<)) aiul half of iho .slaU- Vocational Kducation 
projects ( N) wore thr only projects urthc sample that had completed th. n* federal tundniM be- 
fore the hejonnuiu of our research ^ ^ 
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1 A nationwide survey of 293 change agent projects in the last or next to hist 
\ear of federal funding was administered in November and December 1973 
and January 1974 by the National Opinion Research Center of the Univer- 
sity of Chicago, under a subcontract with Rand. The survey, which included x 
personal interviews with project participants at all levels of the LEA, was 
designed to elicit information about factors affecting a sample of innova- 
tive projects funded by the various federal change agent programs. 

2. Afler the survey was completed, during April and May 1974 the Rand staff 
conducted 29 field studies of projects from the survey sample. The field 
studies, consisting of observations and interviews in project schools, were 
designed to explore and compare the process of change in a number of 
institutional settings for innovative projects with different characteristics, 
funded by the various change agent programs ^ 

Because data collection had to be completed within the 1973-1974 school year, 
the survey and field studies could not be fully integrated (in the sense that the 
results of the survey would establish hypotheses and important research avenues 
that the fieldwork would then explore in depth). However, the two efforts were 
designed to complemciit and reinforce each other. The survey's quantitative infor- 
mation about structural factors affecting outcomes has provided a general perspec- 
tive for the fieldvvork's qualitative, small-sample information about process; the 
fieldwork s in-depth analysis has added realistic detail that has been helpful in 
interpreting the survey data. In short, the two efforts tend to validate each other.". 

The second phase of the change agent study, drawing on the preliminary - 
findings and the data of the initial year, will focus on describing what happens when 
the federal funding for the innovative project is terminated. Accordingly, the Rand 
staff will revisit projects in the first-year sample which were in their last year of 
federal funding. Thus, we will be able to examine hypotheses about continuation and 
dissemination that are raised by the first year's findings. 



FIELDWORK METHODOLOGY 

The fieldwork was undertaken to provide information about the common pro- * 
cesses and interrelationships that influx ce local efforts to bring about change. 
Identification of these common processes and interrelationships requires resolution 
of a number of central questions and issues for each project under study. First, what 
sort of innovation is actually being undertaken? The term "innovation" is used 
rather broadly to cover a great diversity of activities and consequences. Planned 
educational change can vary from the simple introduction of a new textbook, to 
marginal changes in staff responsibilities and relationships, to significant changes 
in teachers' classroom behavior and activities. The differences in strategies and 
objectives not only mean that educational innovations will differ in content, but they ^ 
also imply va»'iation in such important aspects of change as amounts of: s:^ 

" Tu pLice these major empirical efforts within tiie context of federal and state policy, the following 
«»«lditi(^n*jl .steps were taken b> the F^and staff telephone interviews with 54 state education agency (SKA) 
oflicials in 18 states, visits to nino SEAs to interview various .state officials, and a series of personal 
discussion.-i and interviews with OE. HEW. and Congressional ^taff concerning federal policy issues in 
change agent programs. ^ Q 
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• Technical and administrative skill recjuired 

• Risk, a^ .seen by the persons concerned 

• Parent and community response or interest 

• Kfiort recjUired 

• LEA resources required to continue tlie project 

• Impact on participants 

• histitutional change required 

• Support and commitment ro(|uired 

Inirther. many term.s dcbcribing educational treatments and goals are oflen 
imprecise. For example, terms such as "individualized instruction," ''needs assess 
ment.'* "stafi'development." and "bilingual education" are oflen used to cover a wide 
variety of somewhat difierent educational practices and objectives. Thus, given the 
pos.sible variation in the activities, scope, and objectives of innovations as they are 
described in project abstracts and evaluation reports, the first task of the field 
researcher is to understand precisely what is being attempted by the local change 
agent project 

A second area of concern is understanding how tlie institutional setting influ- 
ences the project and identifying how the innovation and members of the school 
community affect each other. Answer^ toijuestions about the significance of the local 
setting oflen involve integration of somewhat difierent views of the change process 
and of project evolution. 

The political and institutional atmosphere surrounding educational innovation 
sometimes makes it difficult to put together an accurate picture of what really 
happened in the course of an innovation. For example, at the district level, adminis- 
trators mav feel compelled to gloss over discrepancies between what the project is 
actualLv doing and wliat was proposed to the state or federal funding sources. They 
al.so ma\ be moti\ated to promote the imageof theirdistrict by inflated claims about 
project accomplishments. 

Within tlie district, somewhat different views may also exist among teachers or 
project administrators. Such varying perceptions of the significant factors in the 
evolution of a project are oflen determined, not merely by the characteristics of the 
innovation itself, but also by the personalities and particular involvement of the 
staff and by the administration's personnel management skills. The result of these 
and other political or organizational factors— from the analyst's point of view— is 
frequent disagreement about project goals, treatment, and impact, or a distorter! 
picture of project activities and liistory. 

A third area of interest concerns project implementation or mutual adaptation 
In order to assess the qualit> of project implementation, it is necessary to determine 
the i'xtvni to whicli mutual adaptation took place, and how and why it occurred. For 
example, project modifications that appear to be similar— modification in goals, for 
example— may have resulted from different motivations and concerns, and may 
have difierent consequences for eventual project outcomes. For iastance, project 
goals may have been modified to conform nioie closely to the nUeds and priorities 
of the local setting. Or they may have been modified because of disinterest or lack 
of involvement on the part of the staff. Understanding project implementation or 
mutual adaptation essentially involves tracing out an "implementation patli" for 
the course of the cliange agent project, and relating activities and decisions to the 
qualitv of project implementation and project outcomes. 

20 

ERIC 
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Fourth, what outcomes of the change a^ent project can be observed? As we 
e\|>laHie(l above, we were not priniarilN interested in asbesbini^^ the impact ofchange 
a.gent projects on bt udents, alt hou^jh evaluat ion evid<^hce was examined where it was 
available. Instead, our major research interest lies in understanding the impact of 
change agent programs on educational practices Will the district continue the 
program in part or w hole after federal funds are withdrawn? Have project practices 
spread within the district? To other districts? Has the project rt^sulted in unan- 
ticipated or "spinoff" effects? 

Design Considerations 

Two primary considerations influenced the design of our ficldwork the state of 
present knowledge and theory about educational innovation, and our interest in 
determining differences in the effects of tlie federal programs included in this study. 

Most evaluations of educational innovation focus on how new practices affect 
student outcomes, and relate program inputs to program outputs. Such evaluations 
typically do not look at the interaction of a project with its institutional setting, or 
at the process of implementation. Consequently, these studies do not fiirnish much 
empirical evidence about the process ot'change, or about the components of success 
and failure. 

The theoretical literature on planned change provides little more help since, at 
present, there exists no analytical understanding of implementation. Vol. I of this 
study represents an attempt to move toward a systematic understanding of innova- 
tion in education. However, in the absence of consistent empirical or theoretical 
understanding of the change process, this proposed theoretical framework is neces- 
sarily very general, and suggests a number of alternative hypotheses about the 
change process. Thus, both the survey and fieldwork components of the Rand study 
are exploratory; they have been designed primarily to generate hypotheses, not to 
test them. The study design for the fieldwork, then, was not constructed with experi- 
mental or quasi-experimental standards in mind. We were less interested in demo- 
graphic or geographic representativeness, for example, than in a project's apparent 
promise to provide interesting data about the process of change. 

1 he study design was further shaped by our wish to gather data about the eflects 
of different federal policies. Therefore, the sample was drawn to include enough 
projects from each federal program to allow us to begin to assess the extent to which 
a particular federal policy (as distinguished from the project site or project focus) 
had an impact on project outcomes. 

Sample Selection 

In order to reduce the variability that might be due to differences in project 
objectives and treatments, we elected to focus on five kinds of projects: bilingual 
education, career education, reading, staff development, and classroom organi- 
zation. The first three reflect the focus of three of the federal programs in our study: 
Vocational Education, Part D; ESEA Title VII: and Righi-To-Read. The lasf two 
categories represent particular types of Title III projects. They were selected because 
of their ambitiousness and complexity, and we expected they would provide rich 
data concerning project implementation and the process of change. 

An additional reason for organizing the fieldwork sample around substantive 
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nroas was to allow (ho slaff.to become complelelv familiar with the jmportant 
aspects of'one inno\ ation. This would allow the stafl to concentrate on variations in 
institutional settings and implementation stratej^Mcs at each site 

I laviuf^ defined these five substantive areas, we elected to study six projects per 
topic, or a total ol'29 projects drawn from the original survey sample of 293 change 
agent projects. The decision to study 29 projects was made on the basis of prelimi- 
nary fieldwork and our re.^ource constraints. Our trial visits to similar change agent 
projects not included in the survey sample indicated that ;klay site visits by 2 
researchers i6 stafi'days> were enough to interview key participants, observe project 
operations, speak with members of the community, and so on We devoted about 700. 
staff days to the case study efibrts— planning site visits, write-ups, analysis, and 
writing\he final report The distribution across treatment areas was subsequently 
modified to reflect the availability of projects and the different levels of complexity 
in the topics (We found that classroom organization projects, for example, required 
more time than did the more straightforward career education projects.) 

The final sample of 29 change agent projects comprised 6 bilingual education 
projects, 7 career education projects, 6 reading projects. 5 staff development projects, 
and 5 classroom organization projects. One staff member was assigned overall re- 
sponsibility for each of the five types of^ projects, including selection of projects to 
be studied. In selecting projects, each team leader loviewed project abstracts for all 
relevant projects, reviewed the project material collected at the project site by the 
survey interviewers, read the survey responses, and, in some instances, made tele- 
phone calls to the project site if issues of project design or treatment remained 
unclear Each research team also reviewed the cmnirical and theoretical literature 
relevant to its type of project. 

Because we were interested in visiting projects which could provide fruitful 
insights about the change proce.ss and successful implementation, we avoided in- 
cluding ')rojects which, on their face, appeared to be poorly designed or unsuccessful 
Previous studies of educational innovation and our own experience led us to expect 
that we would find few truly "exemplary" projects, and very few innovative projects. 
Furthermore, our experience with project evaluation reports led us to anticipate 
frequent di.screpancies between the data reported in project proposals and evalua- 
twm. and the reality of project operation and outcomes Therefore, we expected to 
see unsuccessful projects regardless of the screening device we used But we hoped 
that this method of project selection would improve the chances of finding signifi- 
cantly innovative and successful change agent projects. Indeed, we hoped that this 
screen would result in an oversampling of "successful projects. Given the state of* 
the art. we believed there would be more to learn for policy by studying success than 
by analyzing failure. 

Data Base 

This selection procedure resulted in a project .sample of the following character- 
istics: 

BILINGUAL KDUrATIOW 

Focus, The bilingual projects, sponsored in whole or m part by Title VII, 
aimed at improving English communication abilities. These projects also attempted 
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to enhance .second-lanKuage abililieb and appreciation of li.e culture of the country 
ol'oi \^\n A> the\ nuitured. bihnKual projects were designed to aflect a lari^e number 
of students in a given school, not just non-native-Knglish speakers. Most of the 
material in Title VII projects was presented b\ new bilini^ual teachers or aides hired 
specificallv for the project, rather than by teachers who were in the school before 
the [)roject began. The case studies were conducted at six sites. 

Location and Size, West Blufi*. a town of 7000 located in a sparsely populated 
section of a western state, is a center for farming, ranching, mining, and tourism. 
Its bilingual project served 400 students in grades K-8. The project w^as funded at 
SloO.OOO a year and was in its third year of operation. 

West Bay is in an agricultural area of a coastal western state. Approximately 
one-third of its 32.000 population is predominantly low-income Mexican-American. 
The West Bay Bilingual Project was funded at S225.000 annually, was in its third 
year of operation, and served 700 students in grades K-12. 

Metropolis, a large industrial city of the Southwest, has a population of almost 
1 5 million. Its bilingual program was funded^^at $230,000. was in its fiflh year of 
operation, and served 1300 students in grades K-4. 

Bay City is a seaport community of 600.000 on the East Coast. Its bilingual 
program, in its fiflh year of operation^ served 250 students in grades K-6. It was 
funded at S90.000 a year. 

Seaside is a large western city and a major industrial center Its Spanish-speak- 
ing population is predominantly Mexican-American. The Seaside project served 
2000 students, grades K-6. was in its fourth year of operation, and was funded at 
S500.000 annually. 

Grand Fork is a city of approximately 150,000 in a midwestern state. The latino 
population includes Cubans. Dominicans, Mexican-Americans, and Puerto Ricans. 
Its bilingual project served 250 students in grades K-8. The Grand Fork project was 
funded at $250,000 annually and was in its second year. 

CARKER KDUCATION 

Focus. Career education projects primarily involved the development and use 
of new curriculum materials which supplemented whatever career education 
materials the LEA. had been using in the past. Other career education activities 
involved field trips, counseling, work experience programs, or career information 
centers— each a separate activity somewhat isolated from the rest of the school 
program Career education programs were launched with the broad purpose of 
helping children draw connections between what they were being taught and what 
they would have to know to earn a living. 

Location and Size. We visited seven career education projects. Tip County is 
a rapidly growing southern suburban area with the largest school system in the 
state. The community is middle class to upper middle class; white-collar employ- 
ment is provided in a neighboring large city. The-black student population is less 
than 10 [)ercent. Its career education project is a federally administered project 
funded at $150,000 a year. The project was in its third year of operation. 

Coaltown, a small isolated mountain community in the heart of the Appala- 
chian coal belt, has become relatively prosperous since the oil shortage. Although 
the minority population is small, there^s a surprisingly high fraction of welfare 
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f'amiheb. This federally administered career education project served 1300 students, 
wa.s funded at $150,000 annually, and was in its third year of operation 

Midville IS a prosperous small city in the heart ofthe upper Midwest industrial 
region Theconimunitv is blue collar and predominantly middle class Blacks consti- 
tute .about a quarter ofthe school systems 14.000 .students. The Midville career 
education project is a state-administered project in its third year of operation. The 
project had a target group of almost 8000 students and was funded at $100,000 a 
year. 

Kastplace is a small northeastern town of about 35.000. Although located near 
a major m.etropolitan area, the community— largely working class or lower middle 
clas>— works locally in light industry. The Portuguese constitute the largest minori- 
t\ group (8 percent) The Eastplace career education project is state administered 
It served 4500 students, was in its third year of operation, and had an annual 
funding of SIOO.OOO. 

Bikson County, located in the "New South." is composed of urban, suburoan. 
and a few rural communities, such as Victor, which was selected for the career 
education project because it was the most economically depressed and isolated part 
ofthe county. Blacks constitute one-third ofthe population and half of the school 
enrollment. The career education project served 5000 students, was funded at $150.- 
000. and was in its third year of operation. 

Lakewood. one of the largest cities in the country.* is located in the upper Mid- 
west. It IS heavily industrial and is divided eabt-west between blacks (one-third of the 
population) and whites (largely ethnic). The Lakewood project was funded by both 
state and federal funds. $100,000 respectively. Tne project served 13,900 students 
through the state portion and 5000 students through the federal portion. Lakewood 
has received federal funds for three years, and state funds for one year. 

Northshore is a large seaport city in the West. Its central population of over 
500.000 is predominantly working class, with significant fractions of blacks and 
orientals. Northshore had both state and federal career education projects. The state 
portion ofthe project was funded at $75,000. and the federal portion at $150,000 per 
year. The project served 16.500 students under the state portion, and 1800 under the 
federal portion. Both state and federal support were in the third year. 

KKADING 

rocus. The selection of reading projects was limited to urban districts 
attempting to implement a "complete" reading program that utilized the diagnos- 
tic/prescriptive method of instruction. We restricted our reading sample to urban 
sites because large cities are where low reading achievement is thought to be a more 
critical problem and where change is believed to be more diflicult to achieve. 

Although confined to a single curriculum area, these reading projects have 
generally sought considerable change in the instructional style of participating 
teachers. This change is brought about primarily through in-service training and the 
use of reading specialists who work to help teachers develop <heir own techniques 
and materials, adaptable to the needs of their own students. Some ofthe less com- 
plex projects make extensive use of reading specialists, textbook changes, or pull-out 
remedial programs which add little or no burden on the regular classroom teacher 

Some of^the projects varied considerably in practice from the description in 
their abstracts. One ofthe Title III projects used its funds primarily to assist in 
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chan^m^ to open-spacu bchuolt.. Another Ui>e(l tlieni to adopt new ba.^al texts incor- 
porating a simple dn^qiostic prescriptive technique Three of the Ri^Hit To-Head 
[)i()jects attempted U) de\ elof) \\orksho[>s and dehvery s\ stems for in-chiss foHow-up 
to implement dia^^nostiC' prescriptive reading. The fourth expanded an already func- 
tioning reading system to two additional schools. 

I.ocation and Size. We visited six reading projects 

Adamstoh, a northeastern city of 400.000, has long been a center for transporta- 
tion, a distribution point for many of the nation s leading products The population 
IS moving away from the deca\ing. of\en violence-prone, inner city. Adamston's 
Right-To-Read program, in its second year of operation, was funded at $100,000 
annually, and served 400 students in grades K-2. 

Middleton is an old northeastern seaport city with many diversified industries. 
Its most serious inner-city problem is racial strife in its schools. Middleton had a 
Right-To-Read project, which was in its second year, was funded at $100,000 annual- 
ly, and served 2300 students. 

Rockton, a midwestern city in a predominantly agricultural state, is a major 
manufacturing c%ter. with a population of about 800,000 made up of Germans, 
Poles, blacks, and Chicanos. The Rockton Right-To-Read program was in its third 
year and was funded at $100,000 annually. The project target group was the student 
population in four elementary schools and supported the addition of 4 4 reading 
teachers to these schools. 

Brickton, a seaport city in the Northeast, has been largely rebuilt in the last 
decade and now supports a diversified manufacturing industry. Almost half of its 
population of over 1 million is black. The city has long been considered a center for 
learning. Its Right-To-Read project attempted to have a citywide effect on reading 
and so describes its target group as 225 schools. The Brickton project was in its third 
year of operation and was funded at $100,000 a year. 

Lindaton is a middle- to upper-middle-class residential suburb (population 50,- 
000) of a large midwestern city. The school district is known for the quality of its 
teaching staff and for its innovative practices. Many blacks are now migrating to 
Lindaton The Lindaton reading project is funded by Title III, Section 306, at $89,000 
annually. The project was in its third year of operation and served a target group 
of 5300 students in grades K-7. 

Able is an older northeastern city with its share of inner-city problems. A Title 
HI. Section 306. project (Baker) was in its third year, served 350 students, and was 
funded at $190,000 annually. 

STAFF DEVELOPMENT 

Focus. The staff development projects had a general aim of improving teach- 
ing effectiveness— usually with a heavy focus on human relations and behavior 
modification techniques. The projects typically involved several weeks of training 
for .selected teachers, aimed at exposing flaws in their traditional style and providing 
a new approach. Sometimes this training was a.^sociated with more ambitious dis- 
trict plans for changing its educational program 

The staffdevelopment cases demonstrated a range of techniques— from sophis- 
ticated .system-engineered development strategies to the unadorned provision of 
written materi<ils to volunteers— and a range of consequences associated with teach- 
er-focused change efforts Two projects inv^Y^l classroom interaction by trainers 



with little or no material ■ upporl Two other projoctb relied almost exclusively on 
material.^ »\\orkbook>. .self-wisti ucUona! sequences, etc I The siteol'trainin^^ varied 
'rom special laboratorv situation.^ at dh^trict headquarters toofl-campu^ location^ 
Trauierb ranged from outside "one-.shot" consultants to teacher-peers on temporarv 
assignment as trainers. 

Some development efibrts were targeted on partiiular groups of teacher^?, while 
other.^ had no focus except on the faculty as a whole. In three places?, the project team 
had the total support of the svstem s leadership, hi others the intervention subvert- 
ed that leadership. hiteiestingl> enough, a couple of projects were applied to faculty 
populations wliich felt no need for the project and had no desire to change. 

Location and Size. We visited five staff development projects 

Lewi.son is a small, essentially rural community near a major midwestern city 
Its population is largely white, blue-collar, and working class. The Lewison staff 
development project was in its second year of operation. The project was funded at 
SIOO.OOO annually and focused on a target grcup of 57 teachers in the district. 

Dodson. a large southwestern city, has a population that is 40 percent black 40 
percent Anglo, and 20 percent Chicane. Many of the problems that are associated 
with uiban education are reflected in the Dodson school system and magnified 
through the state and regional culture. The Dodsoi. staff development project was 
in Its third year, was funded at $240,000 annually, and attempted to reach all of the 
teachers in the district. 

VVagonia is an outpost of a manufacturing company's empire in the Middle 
West. The school system serves 35.000 students in 75 schools Although surrounded 
by farm country. Wagonia is urban. The staff development project in Wagonia was 
in Its second year, was funded at $83,000 a year, and served 60 teachers in grades 
7-9. 

Bloomvale. a suburban, town within easy commuting distance of a large 
northeastern city, has grown dramatically in the past two decades to its present 
population of approximately 30.000. U is an aINwhite. solidly upper-middle-class 
community with a school population of about 6700. The staff development project 
in Bloomvale was in its thud year, was funded at $20,000 a year, and had a target 
group of 300 teachers. 
' Metro City, part of a large northeastern metropolitan area, consists of a com- 
plex of enormous, mamly high-rise apartment buildings. Its residents have ex- 
pressed a concern to create, maintain, and protect the schools. The Metro City staff 
development project was in its third year, was funded at $264.000 a year, and served 
all of the teachers in the entire educational park complex, grades K-12. 

CLASSROOM ORGANIZATION 

Focus. The Title HI projects which we have grouped under the general head- 
ing of\'lassroom organization were somewhat unique in that they typically involved 
a complete cross section of the student body, included several or all subjects, and 
attempted significant change in most of the classroom teachers* activities. Further, 
the changes supported by these projects— team teaching, open classrooms, multiage 
grouping, alternative schoolh^-generally represented a clear change from previous 
and more traditional di^>trict practice. These changes were usually supported by 
intensive in-service training efforts to assist the staff in implementing the change 

Location and Size. We visited five classroom organization projects. 

on 
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Ea.sto\vn. a district which undortook an open-education prOjecl in twO'-ol^ its 
elenientarv schools, is a t>pical norlheai>lern i>uburban coninuinity. with bne-faniilv 
neativ landscape^! homes. The people are politically conservative, and tHe school 
population of 12.000 is almost entiiel\ white. The project was in its third^yemihad 
an annual budget of S75,00O; and served 850 students in two K-5 schoo|^s. 

Centerville. a small farmmg and academic town located m the rolliug hills iS 
the upper Midwest, used TiHeill funds to support a project ofdifierentiated stalling 
and team teaching. People in this district earn ^their living at a small prestige 
college, on farms, as tradesmen, or as professionals A tlYird of the town s population 
IS black. The Centerville project was in its third year, was funded at $150,000 a year, 
and served 650 students— half of the students in each of thTee elementary schools 
and all of the students in one junior high schopl. 

Sandwood is one of the lar-gest cities in t|ie Southwest, sprawling over a wide 
area The school population of 125,000 represents a wide range of socioeconomic 
status and a large number of chifdrvn from famOies with a high rate of mobility, 
Mexicans, and more recently blacks. The Sandwood Title III project, which was in 
its third year, served 800 students^was fxinded at $260,000 a year, and attempted 
to combine multiage grouping and open-education stratrgies. j 

Seaside is another large sprawling southwestern city. The school under study* 
Roose\elt. is located in a middle- to upper-middle-income area that has been stable 
and predominantly Jewish. Today, black professional families are moving in and 
white families out, at a transiency rate of 50 percent. The Title III project in opera- 
tion at Roosevelt,^ like the Eastowai project, had as its objective changing an entire 
elementary school over from traditional methods to open-classroom practices. The 
project was in its third year of operation, received iS90,000 a year in Title III funds, 
and served 600 students. ^' . \ • * 

Northwood. our fiflh classroom organization s|jte, is an important city in the 
Northeast. Its population of over 100,000 is predomi^nantly white Irish Catholic and 
is engaged in shipping and trade.'As tlie dd^downtoWfi area decays, the whites move 
to the suburbs. Blacks constitute a tenth of the city's population and a third of that 
in public schools. This project used Title III fund§ io support a storefront, alternative 
secondary school foy'high school dropouts. The project has been receiving Title III 
lunds for two years <S120,000 annually^ and serves 125 students. 

Research Activities 

Two devices were utilized to ensure that^the case studies of these substantively 
diKerent projects would p: jvide generally comparable vlata. a broad research guide 
and staff training sessions. The research guide we developed (presented as Annex 
A to this volume) drew on the conceptual framework described in Vol. L This 
research guide was pretested by member^ nfeach case s* iy area during a week-long 
vwit to one of two major districts, eacf of which contained the full spectrum of 
projixts represented bv our study. The guide was revii:^*d based on this preliminary 
field experience. 

Afler the fieldwork procedures were pretested, all of the staff participated in a 
three-dav workshop that was designed to work out common definitions and perspec- 
tives for approaching particular problems. Midway through the fieldwork, a cne-day 
meeting was held for all of the field research staff to coordinate impressions and to 
ensure that all issues of interest were beir^^ covered. 
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Neither the reboarch ^aude nor the training sebbions were intended to constrain 
thehtnirtu Ibllow y rigid or identical data collection plan. Instead, the\ wevQ intend- 
ed U) [)i()vide comparability in the isbueb addressed, in the terminology used, and in 
the t\pe,bordatn collected within a broad conceptual framework and analvbib phui 
The btali'was explicitly given llexibilit\ to pursue idiosyncratic but potentiall\ 
important factors at each site 

Site Visits 

Aller the projects had'been selected, the team leader called the project directors 
to request permission to \isit the project, to discuss the general framework and focus 
of the btudy. and to make tentative plans for the visit. Before visiting a project, the 
research team reviewed all of the project documents collected by our survey inter- 
viewers, read the survey responses, and examined SEA or federal documents rele- 
vant to the project in question 

Kach site visit usually began with an interview with the project director, attend- 
ed by both members of the research team. Following this initial briefing, the team 
^|)ht up to observe project ciassroonis or facilities/to observe nonproject classrooms 
where this was appropriate, to talk w;ith project participants and members of the 
central administration, and to meet with members of the community (such as news- 
IJaper reporters and parents). Most of thes^ interviews lasted approximately P^a 
hours. Informal discussions with students were oflen conducted during classroom 
observation periods. A numbef of our site visits coincided with evening meetings of 
intere.st to the school community—PTA. the school board. Title III advisory board, 
and the like. Whenever possible, the research team attended these me3tings and 
talkecf with participants. 

Our Meld vFsits were faciliUited by the fact that the stafl'had already read all 
available project material and surVey responses before entering the district. Conse- 
quently, little time had to be spent gathering background inlbrmation on project 
characteristics The staff was able to focus fairly quickly on questions of project 
initiation, the factors that influenced project development and implementation, and 
the characteristics of the institution and the project that participants thought were 
critical in explaining project outcomes. 

Field notes were dictated ai the end of each dijy. Case sjtudios of-each project 
were then written drawing on these notes and upon the documenttiry evidence 
•collected for the project— evaluations, proposals, budget* reports, ne\v^^>aper clip- 
pings, and so on. (See Annex B to this volume for an illustrative listing of the 
material collected for one project.) The^taff member. responsible for each treatment 
area then reviewed all of the case studies and prepared a synthesis of findings for 
innovations in that area. The syntheses and the case studies, which are published 
separately as appendixes U) this volun;e, then served as the basis for the main body 
of this report. 

SCOPE AND LIMITATIONS OF THE ANALYSIS 

This report is a descriptive summary and a .synthesis of the 29 ca.se studies we 
conducted in the first year of the change agent study. It is organized around the 
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contvptua^ framework for the change process that is described in Vol. I. Since that 
volume provides the theoretical context for the entire study, vve assume that the 
read is familiar with that framework. The findings presented here are those that 
appear most consistently and compellingly throughout our case studies; findings 
that are particular to any one of the five innovation areas can be found m the 
synthesis section of the appropriate appendix or in the appended case material itself. 

Three general limitations of the analysis presented in this report should be 
made explicit. First, since the fieldwork was designed to be exploratory, the analysis 
that follows attempts only to describe and interpret the processes that were common 
to the projects we visited— not to make statements about innovation ir education 
generally. 

A second limitation is related to the first. We have made no attempt in this 
analysis to give equal reference to the case study material we gathered. 

The reader will notice that several of the projects are cited far more than others, 
and that some are not mentioned at all. Our unrepresentative use of our case data 
stems from the general purpose of the research— to begin to understand the process 
of innovation systematically— and from the nature of the data themselves. 

The projects we visited varied significantly in terms of their centrality and 
complexity. By project centrality, we mean the extent to which an innovative prac- 
tice seeks to change the goals, norms, or patterns of behavior that are perceived to 
be core or central to the institutional setting of the school. Or, viewed another way, 
centrality refers to the amount of |/erceived displacement of central and routinized 
behavior that is expected to accompany implementation or incorporation of an 
innovation. 

Project complexity refers to the extent to which a project proposes a relatively 
complicated, far-reaching treatment and the extent to which that project attempts 
to aflect the behaviors of a number of groups within the system. Complexity thus 
assumes a fairly high level of coordination. Project complexity may vary along the 
foljowing dimensions: 

* . Target Group Focus. The smaller, more homogeneous, or specifically 
defined the target group, the less complex is the project. The most complex 
projects, for instance, involved the entire student body or an entire class- 
room. 

Curriculum Focus. The smaller the area of curriculum involved (read- 
ing as opposed to open education, for example), the less complex is. the 
project. 

Behavior Focus. The broader the change in teacher behavior and atti- 
tude aimed at, the greater the complexity of the project. 

Integration. As used here, this last factor indicates the degree to which 
the activities constituting an innovation are interrelated, both among 
themselves and with the other activities of the district's educational pro- 
y gram. The greater the amount of integration required for project activities, 
^ the more complex the innovation 

The data concerning common processes and activities that were generated by 
highly central and complex projects provided much richer insight into the change 
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protess and consequently were given giealer weight in our analysis. That is, the 
process ol' implementation v\e observed in a classroom organization project not only 
had much more to tell lib about the change process than did similar observations in 
bome ofthe very narrow and ancillary career education projects, but these data also 
assumed more significance in our analysis because the projects were inherently 
harder to carry out. 

Consequently, the case study data that are used throughout the text to illus- 
trate our findings are drawn from those project studies which we believed had the 
most to contribute to our understanding ofthe change process. Any attempt to 
tabulate or quantily our findings across the case studies, then, would incorrectly 
imply that all ofthe case data had been given equal v/eight in our analysis. Given 
our sampling procedures and the variation in the projects we visited, we believe that 
quantification— or implicit quantification— of our data would be neither meaningful 
nor methodologically sound. 

The third limitation is related to the stage of our research. The findings and 
hypotheses presented in this report are based on data collected in the first phase of 
an ambitious and complex study of federal change agent programs. The second 
phase ofthe study v/ill draw heavily on the experiences of this first phase. Conse- 
quently, it should be stressed that this report describes an interim analysis and that 
we expect our findings to be refined and modified by our subsequent work. 
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IL INITIATION 



Project initiation is the first phase of innovation; it includes identification, adop- 
tion, ancj design of* a particuhir change agent strategy. Specifically, the initiation 
stage iiicludes generation of support for a proposed innovation within the LEA, 
identification of'the objectives and strategies which will compi ise the project design 
and focus; preparation of'change agent project proposals; and the operational plan- 
ning and programming which take place between the time a district can assume it 
will receive outside funding and the time when project activities must be carried out 

This first phase of the change agent project s life cycle is of particular interest 
to policymakers. It is then that federal programs appear to have the greatest poten- 
tial to affect projects. During this phase local school personnel formulate their 
response to the different explicit and implicit incentives contained in the various 
federal change agent programs— from the noncategorical, competitive Title III pro- 
gram to the targeted Title VII program. We observed that these different federal 
programs tapped somewhat different local interests, which in turn often led to 
significantly different expectations for project outcomes, and to different courses of 
implementation or continuation. 

The following sections discuss the incentives and motivations that were char- 
acteristic of the change agent projects we visited, the import they had for the various 
initiation activities themselves, and their consequences for the future of the innova- 
tive project. 



WHY ARE PROJECTS INITIATED? 

The "decision to adopt" an innovation has long been of interest to analysts of 
planned change and diffusion. Four alternative paraaigms have been proposed to 
explain the behavior and motivation of potential adopters: 

1. The Problem-Solving Model, which focuses on user needs, and emphasizes 
search and selection processes. 

2. The Social Interaction Model, which focuses on patterns of diffusion, and 
stresses the importance of information about **better" practices as a stimu- 
lus to change. 

3. The Research and Development (R&D) Model, which assumes an ongoing 
search for more effective practices and outlines a rational sequence of goal 
setting, search, planning, implementation, and evaluation. Included in this 
model is the "experimental" adoption of new practices. 

4. The Linkage Model, which draws upon the preceding three but points to 
the potential contribution of outside agencies— or linking agencies— such 
as the SEA, regional labs, nearby universities, or USOE, in promoting and 
assisting change efforts.* 

' See Ronald U llavelock. The ProLCSs and ^iiratc^iy of lknelivial Cfum^VH, An Analysis and Cnttquv 
o/ Futii Petsfjeitivcs. Institute for Social Research, Center (or Research on Utilization ofScientific Know! 
Univer.sitv of Mic[\igan. Ar > Arbor. Ni.chiKan, n.d. 
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In addition, there is a fiflh "moder* of change or adoption which is acknowl- 
od^^ed bv funding agencies and grant recipients alike, but which has not been dig- 
nified by formal description in the research literature: opportunism, where the 
dominant stimulant in local initiation of*innovative projects is simply the availabili- 

tv of outside dollars. 

At the broadest level, four factors interact to spur the initiation of change agent 
projects: the availability of a "good idea," the availability of federal funds, local 
needs, and the incentives of individual actors. In the projects we visitea, the weight 
and particular significance of each of these factors in stimulating project adoption 
varied from district to district. But, in general, the initiation [irocess we observed 
was characterized to a greater or lesser extent by two of these 'views of adoption, 
opportunism and problem-solving. In only one or two of the 29 projects we visited 
could the local initiation process be characterized by the social interaction or linkage 
models of* change None of the projects in our sample evidenced an R&D approach 
to change. Local schoolmen generally did not initiate change agent projects in 
response to new icfeas or information from outside the LEA, nor did they follow an 
ex|)erimental or even quasi-experimental R&D approach to planned change In fact, 
the projects we observed displayed a remarkable kick of experimental interest; they 
were not initiated to see if some totally new program would work, instead, an LEA 
usually initiated projects in response to locally perceived needs, projects with which 
the district or the main participants already had experience, or projects suggested 
by federal funding guidelines. 

The availability of special project funds has become an accepted fact of life 
within most sizable LEAs. Indeed, many medium to large districts employ a special 
staffer a federal program officer whose only job it is to identify and apply for special 
state or federal funds. The availability of lederal funding was seen as an essential 
factor in initiating the change agent projects we observed-eit^er as a solution to 
an identified need or as an end in itself Local administrators said they could not 
have undertaken projects of tiie size and scope of the change agent projects without 
outside funds. But the incentives which prompted districts to apply for these funds 
varied and led to different change agent project histories. 

The clearest examples of simple opportunity-based behavior- in which projects 
were initiated for the most part just because the money was available, occurred in 
the Right-To-Read and career education programs we visited. In both cases USOE 
assumed that all districts had similar general needs, and detailed proposal models 
were readily available or were not required at all. Little prior commitment on the 
part of the recipient district or participating schools was required. In the Right-To- 
Read demonstration projects, for example, districts received money even before any 
plans were formulated for how the funds would be spent. This procedure was intend- 
ed to" provide maximum flexibility to the LEAs in using those special funds. But it 
is not surprising that some districts tended to see Right-To-Read as a grant-in-aid, 
and sometimes used these funds to support local priorities, not the special program 
specified by Right-To-Read guidelines. » , , r 

Projects generated essentially by opportunism were characterized by a lack of 
interest and commitment on the part of local participants---from district adminis- 

' Since none orihebc probiern-.solvin^' tvpe^ of initiation activities in our field sites included serious 
search activities;, or consideration of alternative strategies, these activities do n<,t compnse thetrnditional 
—and esseiUiallv rational— problenvsolvin^j paradigm 

32 



20 



trators to cla,sroom teachers. As a result^ participants were often indifferent to 
project activities and outcomes, and little in the way ofseriou.^ change was ever 
attempted— or occurred. 

Those projects wiuch came closest to the problem-solving model were initiated 
primarily in response to locally identified needs and priorities. F'or exaniple, in 
Centerville a new superintendent came into the district with a mandate to imple- 
ment a new educational philosophy which had recently been articulated by the 
school board. This new philosophy embraced the notions of individualized instruc- 
tion and respect for the child v^^hich characterize the open-education movement. It 
was generated by both community and faculty concerns that traditional programs 
were perpetuating what they called the "dismal institutionalism'' of their schools. 
The Title III project represented the superintendent's attempt to meet this need. 

In Midville, however, a career education project was initiated not as a change 
in district practices but as an expansion of an existing program. Midville had ex- 
pressed interest in career education before federal funding v;as available explicitly 
fnr this purpose. The pleasant suburban community had a record of progressive 
management and had been operating several exemplary vocational projects. It em- 
braced the idea of career education when it was just being developed at the federal 
level and began a project under Title I. When funds then became available explicitly 
for career education, the district used the money to expand its program beyond the 
Title I schools. Throughout this period, the project remained a high priority for the 
district. 

Unlike Midville and Centerville, Seaside initiated a Title III project in response 
to pressure for change from the school, rather than the district, level. This Title III 
open-education project was the result of teacher demands that "something be done** 
about classroom problems arising from change in the characteristics of entering 
students. 

In all of our cases we found a consistent relationship between the educational 
importance and priority of the needs which generated the project and the degree of 
success it eventually achieved. Where federal funds were viewed as a way to support 
a solution to a specified local educational need, then commitment tended to be high, 
and the project itself oflen constituted a significant departure from current district 
practice. Explicit expression of district interest in a change agent project encouraged 
project participants to take project objectives seriously and to work hard to achieve 
them. An innovative project is both a challenge to the status quo and a complex 
technical undertaking. Thus it oflen faces many political and administrative road- 
blocks.' In the projects we visited, it was apparent that unless those responsible for 
project support — usually the district staff— expressed clear interest and commit- 
ment to the goals of the project, each obstacle tended to compromise the project *s 
basic concept more and more, and to erode whatever initial staff enthusiasm existed. 

We observed another mode of project initiation which could also be character- 
ized as "problem-solving" in some sense — but the important difference was that the 
"problems'' and resulting "solutions'* were not identified by local educational per- 
sonnel. And, as a result, school personnel did not evidence similar commitment and 
support for these projects. That is, change agent projects were begun in a few^ 
instances because people or groups outside of the school districts normal political 
system felt strongly about a particular project or need, and developed the project on 
their own with the hope that the district would take it over. But in the projects we 
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visited, these hopes were not realized, the district merely played indifferent host. For 
example, in Bikson. a local university developed a model career education project 
and then "sold" it to the LEA. The faculty even assisted the LEA in writing the 
proposal— but they played no role in the actual implementation. The LEA never 
became seriously involved in implementing the project, howevci. and the project 
never got off* the ground. 

A state Title III project experienced even less cooperation from the LEA. In 
Northwood, a Roman Catholic nun established a private street academy for high 
school dropouts when she couldn't get the LEA to support the idea. Afler two years 
of hand-to-mouth existence based on local business contributions and some state aid, 
the LEA finally agreed to serve as a conduit for state Title III funds, which the 
academy had lobbied for successfully; however, the street academy was denied full 
incorporation into the LEA. 

The few projects initiated by the LEA man.agement, for reasons other than 
concern for a particular educational need, did net fare much better. In two of^nur 
caieer education sites, the projects were initiated because the community demanded 
them. In both cases, these were Model City areas for which special vocational educa- 
tion funds had been set aside. When the community initiated the projects and 
demanded the right to run them^ both the LEA and USOE gave in to its requests. 
Tnese projects were used as devices to hire people from the local community and had 
no clearly dc/ined strategy. Both were marked by Internal political strife and dwin- 
dling support from students and parents. And, in both cases, the LEA completely 
ignored the project. 

In summary, most change agent projects were initiated either primarily as a 
response to available money (opportunism) or in response to an educational need 
identified by individuals in the school community (problem-solving). Other projects 
represented either an outsider's solution to a need also identified outside the LEA, 
or a local response to a demand made by a group outside the district bureaucracy. 
Opportunism occurred most frequently in response to categorical, targeted federal 
programs, or when funds could be acquired by routine proposal preparation, 
whereas the competitive "untied" nature of Title III funds (particularly state Title 
HI) sometimes promoted a problem-solving approach to change and permitted dis- 
trict stafi* to start up projects that responded to local needs and interests. These 
diverse incentives and motivations for innovation were important because they 
implied different degrees of commitment and support. Furthermore, in the projects 
we visited, unless the commitment was there from the start, it never built up once 
the project began. 



PROJECT IDENTIFICATION 

The first step in the initiation process, then, is when LEA management recog- 
nizes that a project should be considered either to deal with a particular problem 
area (reading, teacher performance, etc.) or to take advantage of a particular source 
of funds (Title III, Vocational Education, Part D, etc.). The next step is design and 
development— the means by which the project's objectives will be carried out. This 
phase should be of particular interest to federal policymakers because it represents 
the single most important opportunity for inducing the LEA to try something new. 

34 
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During this phase, one might expect to find the LEA, particularly the problem- 
soJving one, engaging in some type ofsystematic review to identify treatment meth- 
ods or packaged materials which could be used to fulfill the objectives of' its project 
All of the fields we studied have been analyzed in the educational literature, and 
many corporations and individuals have developed commercial materials for such 
projects. 

But, surprisingly, this type of search seldom if ever took place — despite the 
many and varied incentives which may have prompted interest in proposal prepara- 
tion. Typically, the people who were formulating the project turned to familiar 
sources or treatments. In Lewison, a nucleus of fbur staff members wanted to emphi^ 
Ifjze student involvement, individualized instruction, and building up student s?fiw 
concept as part of the educational process. One of them, who had raised fi^deral funds 
before, was encouraged to write a proposal for a Title III project that would work 
toward these aims. She wrote ths.^ proposal along the lines suggested by a program 
in pre-service teacher education at a local university that she knew about. 

In other instances, federal change agent money was used to expand an existing 
practice. In Sandwood, for example, the Title III multiage childhood education 
program was initiated in order to apply more widely the approach of a pilot program 
undertaken in the district the year before. As mentioned previously, the Midville 
career education program built explicitly on the district*s past successful experience 
with career education. 

The ideas for change agent project methods and strategies can come from three 
principal sources: 

• Individuals or group*^ within the school district (often those specifically 
established to identify and secure outside funds). 

• Local advocates (individuals or groups) who develop change agent projects 
essentially on their own, without any serious district support 

• People or units outside the district. 

In general, opportunistic change agent projects tended to rely more heavily on 
outside developers anc' consultants than did problem-solving projects. The source of 
the idea and subsequent proposal development appeared to have an important 
impact on implementation and outcomes. 

A designated working group was by far the most common means used to identify 
and develop projects. If the group worked in isolation, it was likely to face greater 
difficulties in implementation than if it worked closely with a representative sample 
of district staff, particularly potential implementers. Usually a member of the dis- 
trict staff was assigned to write the proposal, or volunteered if the subject matter 
was within his area of special interest. The proposal and project plan, then, were 
developed in isolation, without much participation from the teaching staff or key 
administrators. 

In the projects we visited, we found that no matter how good the quality of the 
treatment finally proposed, the project plan was likely to underestimate the problem 
of winning staff acceptance. For example, in Eastplace, the project director spent two 
years developing career education materials before they were implemented in the 
classroom. The project involved a complex conceptual framework utilizing sixteen 
behavioral outcomes, hundreds of content-specific behavioral objectives, and more 
than forty curriculum modules keyed^ojhe objectives. Although teachers were 
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utilized in developing the modules and objectives, the overall design was the project 
leader's own. One year after implementation, the level of classroom utilization 
appeared to be quite low, and (ev\ of the teachers seemed to follo\y the project design 
in using the materials. 

Similarly, in West Bay, a combination school/community group was formed to 
help develop the project plan. When this group was unable to agree on a single plan, 
four alternatives were submitted to USOE for its final choice. When this group 
continued to act as a steering group during implementation, its inability to reach 
consensus continued to hamper the project 

In Centerville, however.a committee of teachers was formed to work with the 
project leader in developing the project plan. Individual teachers accepted responsi- 
bility for different elements of the plan. As a result, the project was tailored to each 
school, and the staff felt a strong sense of participation and commitment to the 
project. 

Implementation seems to be easier if those responsible for developing the pro- 
ject work closely with the staff members who must eventually implement the pro- 
ject. We found that this early involvement led to an important sense of "belonging," 
to a belief on the part of implenaenters that project objectives were important to 
them and to the target group. This also suggests that communication skills are an 
extremely important qualification for the project leader— much more so than sub- 
stantive skills. 

The second way in which ideas for projects can be generated is by individual 
advocates. The Adamston reading program, as sponsored by Right-To-Read, was 
largely designed and operated by the project director in a single school. In Sand wood, 
a multiage program was begun in a single school, without any outside funds This 
pilot project then became the basis for an extensive Title III multischool project. The 
people who initiated these projects were very committed, which often promoted 
similar 7,eal and dedication in the project staff. Staffenthusiasm, in turn, contributed 
a great deal to helping projects through rough spots and compensated for the extra 
effort of implementation. 

The third way projects were generated was at the initiative of individuals or 
groups outside of the formal LEA structure. When an LEA adopted projects designed 
by outsiders, the quality of implementation suffered. District staff tended to distrust 
"outside experts" and had little patience for complex project rationales. In Coal- 
town, for example, a professor of occupational education, 150 miles away, was hired 
to write the career education proposal and to run the project on a part-time basis. 
His notions of radical change and his lack of administrative experience so alienated 
the teaching staff with whom he had to deal, that he had to be virtually removed 
from the project. The first year of the project was a complete waste of time, in the 
•eyes of the district stafi; Similarly, in Bikson, a local university group completely 
designed a model career education project and turned it over to the LEA to run. The 
district staff then proceeded to eliminate most of the project's key concepts because 
they were too theoretical. 

But an important exception to the disappointment of such "outsiders" projects 
as Coaltown and Bikson occurred when the outsider's plan was brought into the 
district with very strong and explicit support and commitment from key district 
administrators. In Eastown, the idea and design for the Title III open-classroom 
project were brought to the district's attention by an outsider. She "sold'* her idea 
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to the superintendent and the director of elementarv education, who in turn gath- 
ered the bupport ol the principals and teachers in two elementary schools. Once the 
two schools had agreed to participate, the outsider was brought into the district to 
direct the project. Inevitably, there was great resentment toward her during the 
course of the project, largely because she w'as an outsider. But the strong support 
of the superintendent and director of elementary education was able to elicit the 
continuing participation of project schools. Afler three years, the project is adhering 
quite closely to its initial design and apparently is successfully meeting its stated 
objectives. 



PROPOSAL ACTIVITIES 

The next stage in project initiation (oflen concurrent) is to prepare a proposal 
for funding. With the exception of the state plan Title III projects we visited, this 
was usually viewed primarily as an administrative rather than a substantive task. 
The principal issues generally had to do with budgets, and the people assigned to 
write proposals typically had previous experience in ''grantsmanship." 

This attitude reflected the fact that formal proposals were seldom the vehicle 
for selection decisions. Most of the funding sources required submittal of a brief 
project abstract or preproposal as the basis for project selection, LEAs that were 
invited to submit formal proposals knew they were almost sure to receive a grant. 
In fact, in some Right-To-Read projects, these assurances were given even before the 
preproposal had been drafted. Not surprisingly, the formal proposal, then, was oflen 
more akin to a ratification than to a sales piece, and was an attempt to work out the 
details— budgets, funding constraints, and some type of evaluation strategy. 

Title III proposals (particularly state Title III) were somewhat different. Ti^e 
III funds are awarded on a competitive basis, without limit' tion to a particular 
group. As the program has evolved, a high premium has been placed upon the 
development of a comprehensive, well-thought-out project proposal. In fact, Some 
districts leven those with extensive prior experience with federal projects) called 
upon outside consultants and experts at this stage. Some of the Title III projects we 
observed drew on the experience of nearby PACE (Programs To Advance Creativity 
in Education) center staff to help with proposal preparation. Or the SEA itself oflen 
assisted an LEA in Title III proposal preparation, afler the initial screening stage. 
This extensive planning and detailed project specification may have benefits for 
project implementation, but a number of school personnel complained that Title III 
proposal requirements were unrealistic, forcing the staff to specify in advance goals 
and treatments which might lor should) be oiodified over time. Nonetheless, some 
projects saw proposal development as a planning period and used the Title III 
proposal development process as a way of preparing the school organization for the 
needs of the project. 

The Sandwood Title III project staff attributed a portion of its success to the fact 
that the Title III proposal reflected the concerns of many people in the school 
community: district administrators, building principals, parentis, and teachers. In 
fact, the original Title III proposal for this exemplary project was written by a 
parent, afler meetings with teachers and administrators. 
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PLANNING ACTIVITIES 

Mo^t formal project planning activities took place between the time a district 
knew It would be funded and the time when the project was implemented. In the 
project^ we visited, planning was generally an extension of* the idea generation 
phase and was usually carried out by the same people. In Centerville, a university 
professor who was to become the project director began working with the staff* in 
March as an unpaid volunteer to plan the summer s training sessions and the fall 
program. In Rastown, the project director took several of* the project teachers and 
principals on a tour of*the British primary schools. The Seaside project director, who 
was also the building principal, made this tour. 

This early planning usually centered on two major issues, definition of* treat- 
ment and identification of target group and project sites. The former, if not already 
specified, usually occupied a f*ew staffmembers for several months. After funds were 
awarded, the staff sometimes tried to tap all of* the literature which might be 
relevant to implementation. There was belief* among teachers who participated in 
such efforts that the federal government should make more and better packaged 
materials available. But our experience suggested that even where these materials 
were avai lable. the staff usually decided to develop its own. (See Sec. III.) 

In projects that received awards by April or May, there were several months of 
planning before the start of the school yeai\ But in projects that were notified of* 
awards in late summer, very little implementation took place the first year, and this 
first year was essentially a planning effort. 

The "problem-solving" projects devoted considerable attention to developing a 
clear statement of the project^s goals, often incorporating the views of the regular 
teaching staff and providing the basis for selecting treatments. When project staff 
failed to bring teachers into this development effort, the materials they developed 
were often not used for the purposes intended. 

In most of the change agent projects there was an explicit rationale for selecting 
project sites or target populations. Selection of*Right-To-Read sites, for example, was 
supposed to reflect the quality of*reading instruction and reading achievement in the 
school Title VII funds were directed at schools having the highest percentage of 
non-Engiish-speaking students. Staff development projects by and large attempted 
to recruit volunteers to participate in. project training strategies. Most classroom 
organization projects were installed only in those schools or classrooms where there 
was staff interest, and the staff had agreed to attempt to implement project objec- 
tives. 

Sometimes other considerations intervened in the selection of project sites or 
participants. In Sandwood, the project director had wanted to ensure that there were 
at least two project teachers in any one school (for reasons of*moral support) and that 
school principals supported the basic precepts of* the project strategy. However, 
these plans were changed in the early stages when the school board sought to 
establish at least one project classroom in each of* the board members* districts and 
to include Title I in the project. 

In Eastown, project schools were selected on the basis of the characteristics of 
the principal One project school was selected because district administrators saw 
the principal as restless and eager to try something new. The second school was 
selected because the new principal was seen as weak, needing development and 
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extra attention. Afler district administrators made the suKgestion, both principals 
and stalls agreed to participate in the open-classroom project. 

But m the absence of compellmg reasons to include or exclude a given school 
or class in the project treatment, these choices were usually made somewhat arbi- 
trarily by the district statT. Teachers or principals were not oflen consulted. 



CONCLUSION 

In the projects we visited, there was a clear relationship between the way a 
project was initiated and its probable implementation and outcome. The more suc- 
cessful projects were typically motivated by educational needs which had been 
identified by LEA personnel. The resulting commitment and support appeared to be 
important for a number of reasons. 

First, political and moral support from senior management was essential until 
ihe project was far enough along to be completely integrated into district operations. 
Many different forces act to reject innovative efforts. Without management's un- 
equivocal support, this resistance is unlikely ^to be overcome. For example, if the 
project was focused on a school, then the principal's support was required. If it was 
districtwide, then the superintendent had to be clearly behind it. 

In more than one instance, local needs dominated federal intent, and the result- 
ing projects had little fidelity to the LEA proposal for federal funds. Middleton, like 
many other large cities, received a Right-To-Read grant with virtually no stipula- 
tions as to project content. The money has been used, in combination with funds 
from Title I and Title III and assistance from local universities, to provide summer 
workshops for teachers in three new open-space schools. The focus of the workshops 
was on open space, not reading. The project did not utilize any specific approach, let 
alone diagnostic/prescriptive strategy, to improve reading instruction. The project 
director believed it was her job to improve the teacher's overall functioning in the 
classroom— not just in reading. Although the project may succeed in improving 
reading programs, this was not its principal objective. Yet it met a local prionty in 
its contribution to the successful transition from traditional to open-space schools. 

Second, where projects were initiated on the basis of some passing fad or fund- 
ing opportunity rather than because of some long-term need, interest or commit- 
ment was usually superficial and transitory. New fads, demands, and funding pos- 
sibilities arose to distract management's attention, and the project was left to fend 
for itself. This was largely the fate, for example, of the career education projects 
which we observed. 

The third reason why initiation based on local needs and strong commitment 
seems to be important is that school districts seem unwilling to reclaim projects 
which have gone astray. No LEA that we observed ever tried to restructure an 
unsuccessful project to serve some more useful purpose. This was the case even for 
LFlAs which had clearly demonstrated their competence in running other projects. 
Our observations suggest that it is extremely unrealistic to expect a school district 
to do something wise with its federal money if it is not already committed to some- 
thing wise wlien the funds are first received. 
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III. IMPLEMENTATION 



In thib study we have defined implementation as that part of the innovation 
piucesb that occurs when plans and proposals confront reality— when participants 
attempt to carry out the proposed innovative strategy.* As project plans ai . objec- 
tives become translated into practice, principal actors change, issues shifl and are 
re-focused, new interests emerge and old ones change, as do their relative impor- 
tance and their significance for the outcome of the innovative plan. This section 
addresses the following questions: 

• What activities charactfM'ized the process of implementation in the pro- 
jects we visited? 

• What attributes of the innovative project and implementation strategy, as 
well as the institutional setting, influenced the implementation process? 

In making judgments about the extent of project implementation, as well as in 
identif}ing those factors that influenced the course of implementation in a particu- 
lar project, we relied on classroom observation and open-ended interviews. 

To assess the extent to which a project had implemented its objectives, we 
looked at the kinds of materials employed in project sites, and how they were used. 
We observed the staff at work to determine whether they were doing what they said 
(and oflen honestly believ/ed) they were doing, and tried to determine how closely 
these activities con formed to stated project goals. And, whenever possible, we talked 
to the students, parents, and other members of the school community. 

For example, in an open-cu\?sroom project: Was the classroom stocked with 
materials for the student to handle individually, or just with a publisher's basal 
series^ Were the materials easily available for children to use, or did the teacher use 
them for large-group or whole-group sessions? Bid the classroom, bulletin boards, 
and other-displays show a lot of materials made by the children, or did the displays 
reflect primarily the teacher s (or publisher's) artistic talents and interests? 

If the classroom environment was supposed to be noncompetitive and humanis- 
tic, was there evidence of competition among the children for grades or status? For 
example, were only the '*best" papers posted on the bulletin board? Were there 
charts detailing each pupils progress relative to others'? Did teachers tend to speak 
of "slow" and "fast" groups, or did they talk about their student groups in terms of 
their interests and particular problems? Did open-f^lassroom teachers talk about 
"teaching to" their students, or did they see their role in terms of helping them learn 
and pursue their own interests? He v did the students feel about their own experi- 
ences in school? Did they have a sense of sharing responsibility for their own 
learning? Did they feel free to ask questions and explore new areas? 

On the basis of such observations, we made judgments about the **success"~the 
extent--^of implementation for each of Lhe projects we visited. In the Eastown pro- 
ject, the physical environment of the classrooms, the materials and the way they 
wore used, the interaction of students and teachers, and the teaciK^rs' perceptions 
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oi'thcMi- role in the classroom led us to conclude that the project had been well 
implemented and that the central ideat, ofopen education had been incorporated by 
project teachers in their day-to-day classroom behaviv^r. 

However, these "indicatorh** of successful implementation were not present to 
the ^ame extent in the very similar Seaside open-classroom project. The Seaside 
project, in our view, had put into use only the trappinijs ofopen education, and many 
(»f the ^ta^^had yet to full\ incorporate or understand the principles ofopen educa- 
tion For example, even though the project classrooms all had "interest centers'* 
when we observed them in May. the interest centers in some classrooms had not 
been changed since September. This suggested that although project teachers had 
acted on the notion that a diversity of "nontraditionar' materials should be avail- 
able in the classrooms, they did not fully understand the purpose of centers or the 
necessity of changing these materials as they became 'old" and student interests 
changed. 

In this same school, we observed very traditional relationships between stu- 
dents and teachers in which the teachers talked and students listened— albeit on 
rugs, as befits an open classroom. Student teachers in this school told us that a 
number of teachers organized their classes in the small groups appropriate to this 
educational model only^n visitors' day. Other signs about ihe school raised ques- 
tions in our minds about how well open education had been implemented. For 
example, as we waited in the principal s ofHce. a number of children came in with 
".citation slips" for talking or running in the halls or playground. This, too, was the 
only school of the classroom organization projects we visited in which our research 
team was not allowed free access to the classroonis. We were forced to make an 
appointment, even only to observe for a brief period. In sum, in the Seaside project, 
practice was closer to a traditional approach than to the stated open-classroom goals 

In order to understand why a particular project was implemented the way it 
was (e.g.. What was most helpful? What problems were encountered? How were the/ 
solved?, we talked to the major participants at all levels of the school district, and 
tried to put together a picture or a history of what had happened in the course of 
project implementation, as well as to identify the attributes of the innovative project 
and the institutional setting which significantly influenced that history. These 
experiences have led us to conclude that the process of implementation is basically 
a p^oceijs of adaptation between the change agent project and the institutional 
.netting. We can thus begin to identify those attributes of the innovative strategy and 
the organizational setting that seem to correlate with successful adaptation or 
implementation. 



A PROCESS OF MUTUAL ADAPTATION 

Volume I proposed a conceptual model of change based on our analysis of the 
research reports on organizational change and on educational innovation. Our field- 
work lent empirical support to that model of implementation. We found that regard- 
less of project design or institutional setting, in the projects we observed, implemen- 
tation was essentially an organizational process characterized *o a greater or lesser 
extent by mutual adaptation. The (ollowing subsections illustrate the nature of the 
process we observed and suggest how different project characteristics and institu- 
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lional bottin^'h aliectec! mutual adaptation, and how the dillerent adaptations that 
took place during the implementation stage afiected the results of change agent 
projects. * ^ 

The projects we visited were very difierent in their objectives, methods, and 
institutional setting, but the adaptations they made were oflen strikingly similar. 
Most projects made many or all of the (bllowing changes: 

• Reduction or modification of project goals 

• Amendment or simplification of project treatment 

• Reductions • the amount of behavioral change expected from partici- 
pants 

• Reduction of expectations about the impact of the project 

• Changed organizational patterns, 

• Learning new skills or attitudes 

However, the type and t^xtent of n. 1 adaptation that is possible in a project 
depends on the project design, particulai >n how complex and specific the methods 
and goals are. on how fiexiblv the project can cope with unanticipated implementa- 
tion problems, and on the motivations of principal actors. 

The most extensive mutual adaptation took place in projects, such as open- 
classroom projects, that w^ere highly complex, relatively unspecified in terms of 
treatment, and required a significant amount of change on the part of teachers and 
administrators. 

In the Eastown open-classroom project, there was enormous change in the atti- 
tudes and behavior of project teachers In the course of three years, they completely 
"changed over" from traditional to open-classroom practices. They were requirx?d to 
redefine their roles with students, create and use new classroom materials, learn 
new methods for recording and interpreting student progress, learn to coordinate 
activities with parent aides, and so on. 

Project design and st rategies also changed over time. The original idealistic and 
very ambitious goals of the project were revised on the basis of the first year's 
expel lence. w hich indicated that participating teachers were not able to acquire nr w 
,skills and behavior as fast as expected. As a result, teachers* learning "schedules" 
svere stretched out. Project design was further modified in the third yenr when one 
of the two project schools decided not to continue on the path oet out by the overall 
project strategy. While the project design called for both schools moving into inte- 
m\cited-da\ curriculum .strategies in the third year, one school indicated that it 
preferred not to do this but to use the third project year to ^'consolidate" the consid- 
erable new learning which had already taken place. Consequently, in the third year 
of the project, two somewhat different models of op^n education were operating 
under the same project umbrella. 

A staff development project offered an example in which considerable change 
or adaptation was made in project design, but little change took place on the part 
of the participants The Wagonia Title III project began with four objectives: (1) 
reading improvement, {2) improvement in student school attitudes, (3) iiliproved 
intercultural relations, and i4) implementation of differentiated staffing strategies 
Afler two years of project operation, the first three goals were essentially dropped 
In the project. The fourth goal, differentiated staffing, has yet to be met because the 
strategy for achieviitg this objective was based on an organizational development 
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model of change vshich ai>i>umei> that open and improved communication between 
i,tafrib requisite to any change. (Thib has been characterized as the ''truth/trust" 
model ) In two yearb. the sta1i*has not yet been able to achieve truth and trust. Thus 
the project hab not yet faced the question of implementing differentiated staffing In 
this instance, it can be argued that the considerable modification or reduction in 
project goals was a direct result of unchanging attitudes on the part of the staff* 

In contrast to the adaptive behavior seen in highly complex and unspecified 
projects, those projects which exhibited the least .mutual adaptation usually had 
simple, narrow goals and well-specified or purely technological treatments. For 
example, most of the career education projects we visited were implemented essen- 
tiallN as laid out. and relatively little learning or change was expected of teachers 
The exceptions occurred where the projects were designed by outside consultants, 
requiring substantial redesign when they were turned over to the di.strict staff— as 
in Coaltovvn or Tip County 

Nevertheless, some of the highly specified projects, such as the Adamston Right- 
To-Read project, did require considerable change by participants, who were required 
to learn new ways of teaching reading or to add the teaching of reading to their 
regular science or social studies course work. 

We observed that superficially similar types of mutual adaptation oflen were 
the result of very different motivations or events. For example, both the Eastown 
and the very similar Seaside Title III open-classroom projects made like changes in 
their goal staiements afler the first year of project operation. 

As discussed previously, the modifications injhe Eastown project were a result 
of a careful reassessment of the project's idealistic and ambitious initial goals, and 
of a desire to keep in close touch w^ith development of the project. Consequently, the 
goals were rewritten to describe a pace for implementing change which conformed 
more closely with the reality of the project schools. 

Goal modification in the Seaside project, however, resulted from different fac- 
tors and did not help with implementation of the project. The first-year evaluation 
of this Title III project indicated that effects on students fell below the levels spec- 
ified bv the original project proposal. Project participants felt that these disappoint- 
ing results did not reflect a "failure*' of the project treatment but instead were the 
resuli of a shift in the characteristics of incoming students.^ and feared that these 
evaluation outcomes would jeopardize the funding future of the project. Conse- 
quently, the project goals were rewritten in broad and sweeping terms that, in the 
words of the project coordinator, were "all but unmeasurable.** 

Unlike the Eastown project, the goal modification was not the result of careful 
self-assessment and did not lead to more self-conscio' or effective implementation 
.strategies. In fact, this revision seemed to remove the issue of goals from the minds 
of participants; this removal may have been one of the factors contributing to the 
superficial implementation we observed in this project. 

These two cases illustrate the potentially complex and interactive nature of 
pioject implementation. That is. m these instances, although both projects modified 
their goals, the contra.sting con.sequ(?nces of the two adaptations resulted from very 
different and oflen subtle motivations and concerns. These, and other projects in our 

Tlii^ school is IfK'att'd tn luMuiibot hood that ch<inM»nK dcni [)U'(i(>niinan{l\ whiiv to hhak The 
shill itj Mciid cunn>oMtiuM. however, has had no ellect on the souoccononnc chaiaLtcr of the <m\i It 
r ''mains niiddle to upper middle class, mostly professionals 
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field studies, suggest that one must know both what happened and why, in order to 
assess the quality of the implementation or understand variations in project out- 
comes 

For example, in addition tu constraints imposed by project treatment, the na- 
ture of adaptation, the extent to which it can occur, and the consequences of im- 
plementation also of\en depend largely on strategies for dealing with both anticipat- 
ed and unanticipated problems. Though such strategies are usually unstated, they 
are based upon implicit conceptions about the process of implementation and lead 
to somewhat different project strategies. There are at least three such views. One 
standard notion is to think c 'implementation as a more or less automatic or ''self- 
winding" process in which plans are implemented as they are laid out, and achieve- 
ment of a desired outcome depends mainly upon adopting an appropriate technolo- 
gy. This essentially technological concept of implementation underlies th^ "package 
approach" to change and is implicit in the expectation that better technologies will 
ioad to improvements in educational practices and in student outcomes. 

A second and more sophisticated concept of implementing innovation can be 
described as a rational planning strategy. This notion of implementation recognizes 
that innovations, particularly complex and ambitious plans for change, are not 
self-winding, but generate problems that must be ^overcome. However, the strategy 
for dealing with these prohifems assumes that they are more or less predictable, can 
be anticipated, and thus can be dealt with by careful and comprehensive planning. 

A third strategy does indeed view implenlWtation primarily as a process of 
"mutual adaptation"— an organizational process m which an innovative plan is 
developed and modified in light of the realities of the institutional setting, and in 
which the organization changes to meet the requirements of the innovative prqject. 
In this view problems and consequences are not always predictable, and the course 
of implementation cannot be confidently or completely anticipated. Advocates of 
this perspective argue that there are some important factors— such as individual 
incentives or crisis situations— which probably cannot be predicted at all. 

Frcm the perspective of project design, the innovative strategies we observed 
reflected all three concepts of the change process. For example, some of the Right-To- 
Read projects reflected the belief that, once installed, a particular reading strategy 
(such as High Intensity Learning or DISTAR) would generate its own momentum 
and lead to the hoped-for student outcomes. Other projects (such as the Eastown 
open-classroom project) were designed with the expectation that problems would 
arise during the course of implementation, but also with the assumption that careful 
plann m| could prevent such problems from interfering with successful implementa- 
tion. Still other projects we visited ie.g., Sandwood) were designed in th^e knowledge 
that unexpected problems or contingencies would arise. Therefore, organizational 
devices for maximizing flexibility— such as frequent stafl'meetings and the availabil- 
ity of "on-the-spot" resource personnel— were built in to deal with issues as they 
arose and to make whatever changes were required. 

In summary, the extent of mutual adaptation which might take place during the 
implementation phase is largely determined by the substantive design of an innova- 
tion and the motivations of principal actors. But we found that how adaptation 
occurs, why it occurs as it does, and the consequences of various implementation 
activities across project types were primarily related to attributes of the innovative 
strategy and the institutional setting. 

11 
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ATTRIBUTES OF THE INNOVATIVE STRATEGY^^ 

The innovative strategy which characterizes a project res' .s from a number of 
choices about how to implement a specified set of objectives /hat seems to be the 
most desirable or effective thing to do? What is possible? ossible? What process 
fits best with local needs and conditions? What follows L not an exhaustive list of 
those attributes of innovati^ .rategies which we found to be related to successful 
implementation. Rather it is an attempt to set down those features which affected 
the evolution and implementation of projects as we observed them. 

Training 

We found that projects differed greatly, even among similar types (e.g., reading, 
career education), in the timing, amount, and type of training given the project staff. 
The projects we visited ranged from those in which training was a principal ingredi- 
ent to those which offered essentially no training at all; they covered the spectrum 
of pre-service, in-service, less formal "on-the-job** training, or some combination of 
these approaches. Training also ranged from strategies utilizing local experts as 
technical assistants in project workshops to projects that relied extensively on out- 
side consultants. The focus of training sessions ranged from the very general, such 
as philosophical discussions about the inerits of humanistic education, to the very 
concrete, such as how to set up a learning center or develop skill cards. 

As might be expected, training was more important to successful implementa- 
tion in complex projects and less important in highly specified or primarily technolo- 
gy-based projects. In general, it did not appear to make much long-term difference 
to project implementation whether pre-service or in-service training was the pri- 
mary vehicle for introducing staff to the new project strategies. But classroom 
organization projects constituted an important exception. The absence of concrete 
pre-service training in those cases appeared to retard project implementation and 
to ,create more serious problems in the first few years than were encountered on 
other similar projects. 

Both the Sandwood and the Eastown open-classroom projects offered two weeks 
of intensive pre-service training, which in Sandwood included observation in a pilot 
open classroom within the same district. Many of the Eastown staff had seen open 
classrooms in operation in a trip to England the summer before the project started. 
The result of this preparation was that while the staff at both sites experienced an 
exhausting and frustrating first year, they had a notion of what it was the> were 
trying to achieve and most of their efforts were in the right direction. 

In contrast, the Seaside open-classroom project began with no formal training 
for teachers, essentially because of very late funding. Many of the staff knew little 
more about open-classroom strategies than what they may have read in the popular 
press, and practically none of the staff had seen open-education strategies in opera- 
tion. This lack of prior exposure and instruction led, in our view, to the installation 

' Wo arediJ^tinKUibhing between the mbatance of an innovative project- i e , overall goals and treat- 
ment content— and the strateftv for innovalion—i e . the means chosen lor implementing the project 
design For example, no two of the open -class room projects and no two of the Right-To-Head projects 
emphniHl the same process or strategy (or acl'" .ing their almost identical objectives It is the impact 
of thcM' strategic dillerences that we aie or Mng here 
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of" symbolic * open-education practice^, which acknowledj^ed the surface trappings 
of* the concept, but showed little understanding of the central precepts. 

For example, many of the staff m the project dutifully set up interest centers 
and removed most of the traditional furniture from their classrooms. But the inter- 
est centers did not serve their purpose since they were only rarely changed, and the 
teacher continued to use tradiUonal "teacher-talk" methods with children seated on 
the floor at her feet, which nullified the effects of classroom reorganization. Subse- 
quent in-service training and visits to other open-classroom sites did not seem able 
to rectify the wobblv and somewhat misdirected start-up of this project. 

In general, the more training of whatever form (in-service or pre-service) the 
better However^ we found that the benefits of training were conditioned by the 
content of the training p-ogram ai>d by the characteristics of the training staff In 
all of the projects where training was important— especially reading, classroom 
organization, and staf' development— teachers strongly preferred very concrete, 
"how-tO'do-it" workshops (as opposed to a more general lecture format) given by 
hvdl personnel The most smoothly implemented projects were fortunate to have 
either in their project director (e.g., Adamston) or in district resource personnel (e.g.. 
Sand wood) people who knew what they were doing, understood what potential 
problems might arise, and had the experience to make specific suggestions to help 
teachers improve their performance. Conversely, participants felt that outside con- 
sultants performing a similar technical assistance role were almost always ineffec- 
tive and disappointing. For example, Right-To-Read relied on outside technical assis- 
tance more than any other project type in our study— and at only two of the Right- 
To-Read demonstration sites we visited could project staff name one outside expert 
they considered helpful. 

On the whole, personnel in the projects we visited beHeved that outside experts 
could not understand theii particular- problems and were unable to give practical 
advice. 

Meetings 

Some less obvious benefits of extensive training sessions also resulted from 
frequent staff meetings. Projects which made a point of scheduling frequent and 
regular meetings of the stafftended have fewer serious problems in implementing 
project strategies, and demonstrated higher morale and a greater sense of cohesive- 
ness on the part of project staff. Staff meetings not only provided a fbrnm for working 
out problems within the project, communicating p^-oject information, and deciding 
on plans for the future, but also provided support and encouragement fbr partici- 
pants. This support! in turn, led to a greater sense of group cohesiveness and morale; 
it also led to the sharing of "good ideas'' arid broke down the traditional isolation 
of the classroom teac\er. 

Finding time fbr these meetings was a problem which some projects (or districts) 
were able to solve, while others were not. The Sandwood project, for example, 
arranged fbr time off one afternoon a week fbr project staff meetings. Participants 
almost universally singled out the meetings as one of the most important factors 
contributing to proje.ct success. Such time to share ideas and problems was, accord- 
ing to respondents, especially valuable in the rough and exhausting first year of the 
project. If meetings were infrequent or irregular, morale was noticeably lovyer and 
reports of friction within the project staff were higher (as in Eastown and Brickton) 
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Also, the lack of xneetings retarded the shaiing of good solutioiib to common i)rob- 
lems, as in Seaside. 

Meetings were important for yet another reason in the Right-To-Read projects. 
It was easy in these projects to lose the sense of "project," since the program was 
typically spread through three or more schools, and the project director became 
central admmistrator, while the school principal assumed the role of director. Com- 
munication with the central oflice staff appeared to be especially important in 
Right'To-Read if the teaching staff was not to feel somewhat adrift and alienated 
from the project. 

In the Brickton Right-To-Read project, teachers were unable even to identify 
tliL* goals or concepts of the Right-To-Read project. Furthermore, some actions taken 
by the central staff— a series of conflicting memos, for example — looked to the 
project staff like a series of mistakes reflecting disorganization in the Right-To-Read 
administration. These memos, however, were in fact the result of a number of 
central district administrative decisions that the Right-To-Read staff had to respond 
to. The resulting disaffection of the Right-To-Read teachers could have been reme- 
died in part if they had been informed of the cause of the problems. 

In contrast, the Adamston Right-To-Read project director held a number of 
monthly luncheon meetings in which he would "listen to the winds" from his staff 
as well as confront teachers with data concerning their own activities. The director 
believed the relatively high morale and uniformity of implementation in this Right- 
To-Read project were in part attributable to these regular meetings. 

Frequent and regular meetings, in sum, although often difficult to arrange, 
appeared to have a high payoff in terms of reducing friction within the staff', raising 
staff morale, and establishing a sense of project purpose and cohesiveness. 

Development of Materials 

Local staff helped to develop project materials in many projects we visited; this 
activity appeared to make an important contribution to the effective implementa- 
tion of change agent projects. This was particularly evident in the classroom organi- 
zation projects, which were highly complex, inherently difficult to implement, and 
based on no prior, well-specified model of project treatment. However, even in less 
complex projects, the benefit of teacher participation in materials development was 
apparent. Development activities ranged from a careful assessment of existing prod 
acts or technologies, which were then repackaged into a form which refle Jed local 
interests and ne^ds, to activities which, beginning from scratch, produced a wide 
range of project materials. The first approach was most common in the more narrow- 
ly focused well-specified projects, such as Right-To-Read and career education — 
although the more effective career education projects tended to develop all their own 
materials. Extensive materials development was common in the more complex and 
amorphous projects — classroom organization and staff'development — or in the Title 
Vll projects for which no locally relevant materials could be located. 

Materials developn .t was oflen the central focus of first-year activities in 
classroom organization projects, and consumed an uaexpectedly large amount of 
staff time and energy. In Eastovv'n, all of the major materials used in the project 
cLissrooms were developed by the teachers themselves. Even though there are many 
coinmerciallv produced, nidividualized basic skill materials, they were inadequate, 
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in the opinion of the project director and her staff. Consequently, with the help of 
a retired master teacher, the project staff created "task cards'' that could be used 
dia^nostically and also permitted richness and diversity in possible student activi- 
ties. These teacher efibrts have led to the creation of two kits' (Da mathematical 
concepts and skills kit which is coordinated with the rudiments of a criterion- 
referenced'* test, and a math materials resource list that is pvatched to math con- 
cepts, and (2) a language arts kit which includes a plan for developing the mechaniv,^ 
of writing on an individualized basis and a kit to stimulate and motivate creative 
writing. 

Both our observations and teachers' comments indicated that development of 
these kits was central to the success of this project, not just because it may have 
resulted in "better'' products, but because it provided an opportunity for "learning 
by doing" and contributed a sense of pride and ownership in project accomplish- 
ments. The exercise of working through open-classroom concepts, and discovering 
their significance in practical terms of the classroom, permitted teachers to under- 
stand project precepts from the ground up and to incorporate these principles in 
practice. 

Project ofliciais in the Brickton Right-To-Read project acknowledged the contri- 
bution of local materials development Brickton devoted a disproportionate amount 
of time, energy, and resources to the development of a Criterion Performance Assess- 
ment Test to measure the effects of project activities. Our research team tried to 
discover why the project staff decided to develop its own test when there are a 
number of commercially marketed tests that will sepve the same function (such as 
the instrument components of the Wisconsin Design for Reading and the High- 
Intensity System). The general response was that Brickton had had a number of 
disappointing experiences with commercially produced materials, and needed to sell 
Right-To-Read as being relevant to district students. 

"We know our needs," remarked the project director, "so we lliought why- 
shouldn't we try to develop our own?" An elementary school principal said that 
involvement was the main reason why they decided to develop their own test. "We 
did it so that everybody would feel a part of the project." Project personnel also 
stated that local test development allowed them to define a set of reading skills to 
meet the needs of the district s inner-city students. Project personnel expected that 
the Right-To-Read program might be more acceptable to the Brickton schools in 
general if it could be pointed out that the system had been locally developed. 

In contrast, the superficially implemented Seaside open-classroom project did 
no materials development at all. Project stafi' continued to rely on the basal series 
and workbooks they had used before, oflen using these materials in the traditional 
style that the Title III open-classroom project was designed to replace. Not only did 
this staff generally fail to display the thorough knowledge and understanding of 
open-classroom techniques and concepts evident in Eastown and Sandwood, but a 
spirit of project pride and cohesiveness was absent as well. 

The importance of development activities for project implementation was evi- 
dent even in the Title VII projects. The stafi' of bilingual education projects almost 
universally prot.-sted the absence of commercial materials suited to the objectives 

' ( ! jteriuit-refiToncod tests nHMsun* a ,tudent s progres> toward spt^ iHod Koalh iu i\ particular course 
ol instruction Thev ari* distifi^Hii.shcd trom conventional «uhievement tcst.s. which seek to det(-rmine 
student.^* relative ranking in ovendl ^rasp of general subject matte 
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of'then* project. Nonethelesb. it beemed to Ub that the stairiearned a great deal about 
the traditions, customs, and beliefs oftheir target group in the task or.searching for 
and creating appropriate materials for their bilingual activities. 

The creation of materials which were germane to a particular locale also ap- 
peared to be impo'-tant in career education projects. In Midville, films and tapes 
were produced locally and t hus reflected employment conditions; descriptive materi- 
als and even sample job applications were collected from local employers. Efforts to 
produce materials that reflected local job markets and educational conditions gener- 
ally characterized the relatively successful projects. In the less successful career 
education projects, there was an effort, often futile, to secure prepackaged materials 
from other districts, from the SEA. or from publishers. In general, it seemed to us 
that the significance of producing ones own project materials did not lie principally 
in the final product, but in the activity of development itself. This observation 
obviously raises questions about the feasibility of exporting packages and technolo- 
gies vv ith the hope of replicating another project s accomplishment. These issues will 
be explored more closely in subsequent research. 

Voluntary Choice 

The self-selection of project participants and project sites appeared to benefit 
implementation. This is not entirely surprising, since it is like*v that "volunteers" 
may also be those less in need of change, but it does raise questions concerning 
expectations for project dissemination within and between districts, as well as ques- 
tions about the effectiveness of largely "volunteer" projects for "non-volunteers." 
Most projects we visited were developed and stafled by volunteers, people who were 
willing to try something new, and who were partfcularly interested in implementing 
the proposed innovation. In all the classroom organization sites we visited, for 
example, the staff of participating .schools had the option of reassignment if they did 
not want to participate. People who disagreed with project aims or methods, or those 
who rejected the additional workload, were able to leave. They v/ere replaced with 
teachers who volunteered for the project. Furthermore, in some projects, participat- 
ing staff not only were volunteers but were hand-picked by project administrators. 
The teachers charged with implementing the Sandwood project, for example, were, 
in the words of the project evaluator. "excellent by any light. They would succeed 
in any classroom." 

Thus, ^voluntarism seemed to our observers to eliminate much of the resistance 
to change generally expected in innovative efforts, at least among direct partici- 
pants, and also to produce an exceptionally cap..ble cadre of project participants 

Incentives 

Change agent project stalls identified a number of 'reasons why they worked 
hard to implement change agent strategies and endured the frustration, uncertain- 
ty, and fatigue of the first year or so. Interestingly, although a number of the projects 
offered tangible rewards for participation or successful implementation of project 
strategies, the staff most oflen mentioned more intangible professional incentives: 
a chance to learn a new skill, an opportunity to put into practice some oftheir own 
idea.-., a possible solution to perceived student needs. (See, particularly, Eastown, 
Centerville, Sandwood, Midville. Adamston.) In addition, the increased professional 
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btature and \ isibility that often went along with project participation also appeared 
to bolster implementation efforts in the uncertain beginnings. 

In some projects, even tho^e incentives relateci to professional status did not 
appear to be ver> important compared to basic professional interest m the project 
objectiv e^>. One htaff development |)rojeet (Dodson) offered almost any tangible and 
intangible incentive one could think ofto promote implementation. In this elemen- 
tary school training pro?^ram, the trainee teachers were overwhelmingly female, 
place-bound, lower middle class, and secure in their jobs. Among this group, visibili- 
ty, responsibility, ambit. on, status, and extra money were not significant incentives 
for participation or implementation. The only important incentive seemed to be the 
intrinsic satisfaction derived from doing better teaching. We found that trainees 
who believed that the project had made a significant difference in their classroom 
activities all recognized that their previous teaching practices had tu be changed, 
and believed that project activities could improve their skills as teachers. 

But the project staffs we observed were mostly made up of competent volun- 
teers, and we might expect them to have higher than average professional motiva- 
tion. Sonietimes, in fact, professional concerns got in the way of,change agent project 
implementation. In the Eastplace career education project, for example, teacher 
concerns with student reading problems and a district movement toward increased 
teacher accountability for student progress in reading and math led many teachers 
to ignore career education when they felt that it conflicted with their basic classroom 
responsibilities. And, in one Right-To-Read project, the staff of one target school 
refused to implement ^e prescribed Right-To-Read strategy because they believed 
another approach was better suited to their low-income student body. 

Our fieldwork also provided some evidence that without professional interest or 
commitment, more tangible incentives (such as money or credit toward advance- 
ment on the district salary scale) did little or nothing to secure good project im- 
plementation. Such incentives sometimes served to increase attendance at work- 
shops, for example, but they did not seem to lead to the acquisition of new skills or 
behavior. 

!n the Rockton Right-To-Read project, for example, teachers reported that the 
extra money they were paid to attend Saturday morning workshops was not enough 
to make them pay attention to or act on what was being presented. The staff did not 
feel the workshops were important for them because they did not believe the district 
had much commitment to the project. As one teacher said, "If the district were really 
serious about improving reading, they would give us released time during the week, 
not make us come on Saturday morning." Teachers reported that they went to the 
workshops, "but didn't listen." (Similar comments were expressed by staff in two 
other Right-To-Read projects.) Or, in the Lewison Title III staff development project, 
few beyond the initial cadre of recruits could be persuaded to use the project kits, 
even though teachers were paid SlOO for the successful completion of each kit. 

Money and other tangible rewards, in sum, appeared to function effectively as 
a gesture of appreciation (e.g., Centerville); but they were apparently not effective 
by themselves in stimulating interest in a project where it did not exist otherwise, 
or in inducing teachers to acquire new skills if their own professional interests or 
concerns did not lead them to see such new learning as important. 
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Elementary Grade Level Focus 

In the change aKenl projects wo vibiled. innovative projects that included hi^h 
.schools and junior hi^h j^chools were harder to implement than those in the elemen- 
tar> schools The Right-'IVRead projects consistently encountered resistance at the 
high school level as they attempted to persuade science or history teachers to see 
themselves also as teachers of reading. Career education projects had a similar 
experience. Whei-ever project managers confronted secondary school teacliers of 
"solid subjects/* who seemed to have large intellectual and emotional investments 
in academic purity, they withdrew— oflen before any battle occurred. 

For example, the Wagonia Title III staff development which focused on an 
entire junior high school finally had to drop the 9th grade staff from the project 
because of Us lack of interest and reluctance to cooperate with the project. By the 
same token, the staff of the elementary level open-classroom projects we visited were 
concerned about the traditional and somewhat rigid attitudes of high school and 
junior high school staff. Neither thechildren graduating from project classrooms nor 
the proselytizing efforts of project staff appeared to have much impact on the prac- 
tices of upper level schools. Project experience and alumni did not stimulate junior 
high faculties to reassess their traditional methods, instead, project children tended 
to be viewed as "impertinent, noisy, and unable to sit still." (See Eastown.) 

In sum. our experience indicated that not only did high school teachers tend to 
view themselves as subject area specialists, not in need of new skills or attitudes, 
but the students themselves appeared to be less amenable to change. 

Critical Mass 

Although project participantsdid not show much resistance, particularly where 
there was strong district commitment to the project, nonproject personnel some- 
times impeded project implementation. Implementation was a particularly trying 
and tiring experience for teachers in the staff' development and classroom organi- 
zation projects. In some instances, their nonparticipating coPeagues showed little 
sympathy for project objectives, felt threatened by the changes being made, or 
displayed antagonism for the disruption which the project invariably caused in the 
school. 

Negative or indifferent attitudes from nonparticipants eroded staff morale and 
constituted a pressure for the project teacher to "give up" if she felt isolated and 
unappreciated. However, we observed that a group large enough to be a "critical 
mass** of project teachers in a given site could provide moral support, sympathy, and 
new ideas. The existence of such a "critical mass" also appeared (particularly in the 
staff development projects) to generate a norm for change in a school, a norm which 
was unlikely to be promoted by an isolated teacher working to implement an innova- 
tive practice 

Summary 

In summary, we found that projects which were relatively well implemented or 
had the smoothest implementation were also characterized by the following attri- 
butes* cr-^ 
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• A sirong training component 

. Praciical "how-to-do-it" workshops 

• Local expertise nnd technical assistance 

• Frequent, regular staff meetings 
. Local materials development 

• Voluntary, highly motivated participants 

• An elementary school focus 

• A "critical mass" of project participants 

Readers who are students of organizational literature and the general litera- 
ture on planned change will note two obvious omissions from this list of "more 
effective" innovative strategies— the mode of project decisionmaking and the pace 
of prescribed project activities. The currently popular ideology of planned change 
favors a "democratic" style, of project management and decisionmaking and also 
believes that gradual implementation is more effective than a "blitz" style of intro- 
ducmg new practices and attitudes. In principle, this is a persuasive point of^ view, 
bat empirical evidence to support "democratic!' as opposed to "authoritarian" lead- 
ership stvles, or gradualism versus blitz, is inconsistent and not conclusive. 

Our fieldwork also yielded mixed evidence about the relative merits of particu- 
lar leadership styles and pace of project activities. For example, in the highly "demo- 
cratic" Sandwood classroom organization project where staff, parents, and adminis- 
trators jointly and equally participated in formulating project objectives, assessing 
progress, and proposing project activities, the participatory style was frequently 
cited as an important factor in the project s success. However, in the Wagon la staff 
development project, participation and democracy resulted in two years of indeci- 
sion and foot shuffling without much accomplishment. 

Furthermore, there were two projects in our sample (Adamston and Eastown) 
which self-consciously practiced an extremely authoritarian style of management 
However, these projects were also well implemented and highly successful. In the 
Dodson staff development project, the initial blitz strategy was so successful that 
these schools could not serve as demonstration sites. (Project personnel viewed them 
as having achieved too much too quickly and thus as a threat to new recruits who 
would view their accomplishments as "impossible ")•' 

This is not to suggest that differences in management styles did not make a 
difference in implementation. They did. Even though the success of project im- 
plementation did not appear to vary according to leadership and management 
styles, the human costs were high in those projects which attempted to install new 
practices via blitzkrieg. These projects experienced low morale, staff resentment, 
and even threats of mutiny in the first two years of project operation. (See Eastown.) 
In both cases, eventual retaliation against the project by defenders of the status quo 
seemed likely. The human costs of these methods led us to wonder whether such an 
approach to change was necessary. 

We suspect that the relative effectiveness of "democratic" as opposed to "au- 
thoritarian" leadership and gradualism as opposed to blitz may well be determined 
by the situation. The districts in which heavy-handed management led to successful 

^ This dramatic chancre was apparently biou^ht about by the usv oi'.xn intensive human relations 
pro^'nim. designed for recaicitiants. but applied to leceptive voluiiteers 
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project implenuMitation were albo dii>tricti> where there \vai> little active interest in 
educational chani^e "P'orcing" innovation may well have been the mobt effective 
way to brin^' about significant change in such circumstances. 

Parent involvement also plaved a smaller role in project implementation than 
we believed it would. Although community attitudes were a force to be reckoned 
with, the key factor seemed to be how a project was presented to the parents rather 
than its substance. In most of the cases, school officials were left pretty much on their 
own to design and run the project. Parental concern remained a watchful but 
neutral force 



ATTRIBUTES OF THE INSTITUTIONAL SETTING 

Structural and demographic characteristics ofthe institutional setting no doubt 
influenced the selection and initiation of* change agent projects and thereby deter- 
mined the coii^GXt in which we observed project implementation. Given the nature 
of* our fieldwork sample and the fact that the research focused on projects, not 
districts, we were unable to identify direct effects oforganizational status or struc- 
ture that could be clearly related to the implementation process.*' Instead, the 
attributes ofthe institutional setting which influenced the process of implementa- 
tion related to the organizational climate ofthe change agent projects. 

Administrative Support 

In the sites we visited, the extent of support for a change agent project at all 
levels of the district— from the central administration to the school principal- 
influenced the course of project implementation. Support and commitment to the 
project at the district level often seemed to be vital in pulling a project through the 
rough first year. 

For example, when the Eastown open-classroom project almost collapsed be- 
cause teachers threatened mutiny in response to heavy-handed practices of the 
project director, intervention by the director of elementary education was able to 
smooth ruffled feathers and retain teacher (and project school) participation in the 
project Similarly, in Centerville, resistance to team-teaching/open-classroom con- 
cepts or inability to deal with the resulting problems on the part of principals was 
dealt with first by clear guidance and direction from the superintendent, backing up 
the project director, and then by changes in personnel. 

Likewise, the Brickton Right-To-Read project had strong backing from the su- 
perintendent, and the staff said that without this support, "We would never have 
made it in the beginning." (Although, as we will discuss below, the superintendent's 
support later became a liability.) In the initial phase ofthe Brickton project, the 
project .staff ran into some resistance from principals who stopped attending meet- 
ings and started spreading rumors about what was and what was not going on in 
Right-To-Read. The staff brought these problems to the attention ofthe superinten- 
dent, who subsequently called in the principals to remind them ofthe importance 

' An rxct'plion IS tin- Ctueor cduL.ition projt^Us in vnIikH suutssIuI nnplrrncntiihon wa^* mhmi iin our 
^nutli ^«ini{>ie' U) \ ,h\ ^\{(h distikt ^\caith All of ihv reKiti\t'l\ vveil impkint'ntod projects wvw locatfd 
in u)nd'>rt,d)li' suburbs oi [)ros{M'r(>us sin,i!!t*i utics \v ^ . Tip ('uutit\. Mjd\d!(»» i.ai^r cUios exhihitinji 
sNuiptonisul "urban ujsls' <uk1 >uhill towns or ruial anujs did not do neaih so v\<dl iCoiiUoun. HiksonJ 
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o( Right-To-Read in the district and the importance he attached to the project. Aller 
these reminders, the stali'had a good dtul more cooperation, at lea.st overtly, in the 
impact schools 

Conversely, implementation of the Dodson stall' development project was re- 
tarded as a change in .school board membership led to changes in district stalling, 
with consequent weakening olcentral administration support. The new administra- 
tors did not support many of the central precepts of the stall" development project 
and made changes in project strategies and status. For example, the project director 
was "demoted" in the district hierarchy, and an attempt was made to dismantle tbe 
school-based precision learning centers, which were a key component ofthe proj>-ct. 
Some ofthe area superintendents supported the objectives of this Title lil project, 
but most were indillereiit or opposed, which hurt the project. When principals 
looked for signals about the merits of complying,.with the unfamiliar new proce- 
dures, the indilference of their ininxediate supervisors was a clear signal. Further- 
more, a few area superintendents actively oppoMl the program, going into schools 
and even classrooms to 'point,6ujjhaU]ie noise level associated with individualiza- 
tion was "chaotic" and fhat thetarpetsquares installed in the place of traditional 
Att'niture "bred vermin. ' \., 

Similarly, a number of thej;al eer education projects (e.g.. Bikson) and the bilin- 
gual projects (e.g.. West BlulH floundered and failed to achieve much momentum or 
much stair enthusiasm, largely because the central administration was indilferent- 
to project goats. 

School principals' attitudes had even more dramatic and immediate import lor 
project implementation—particularly where participating stalf had a dual alle- 
giance to the project and to the school. One ofthe Sandwood project classrooms was 
located in a school headed by an ex-military olHcer who believed that discipline and 
order in the classroom were essential and did not support the "child-centered" 
strategies advanced by the project. Consequently, the project teachers classroom 
was moved to the room directly across from the principal's office, and the principal's 
visits and complaints about "noise and chaos" were frequent. And, not coincidental- 
ly. as the second year of project operation began, this project teacher fc^nd that most 
ofthe school's "problem" children had been reassigned to her classroom. 

Supportive principals in this project provided quite a different atmosphere, 
going to great lengths to provide extra services for classroom teachers, to make 
schedule changes that would accommodate project requirements, and to encourage 
other teachers in the .school to view the project classroom as a "model" for their own 
practices. The result was increased professional pride and esteem for the project 
teacher and the slow spread of project practices to nonproject classrooms throughout 
the school. 

The relationship between the principal and reading teachers was equally im- 
portant in implementing Right-To-Read projects. For example, one project had a 
troubled first year until frictions were ironed out by reas.signments ofthe Right-To- 
Read staff. Generally, the attitudes ofthe principal toward the Right-To-Read pro- 
ject signaled the rest ofthe staff whether or not to take Right-To-Read seriously. 

There was also consen .us about the "critical" role ofthe principal in the career 
education projects we visi ed. However, it was difficult to identify just how princi- 
pals' actions significantly enhanced project success In most ofthe career education 
projects we visited, the main role ofthe principal was simply to permit the project 
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toexifet in the school. Those fe\v-i>chuoli5 in which principalb werehelf-proclaimed cind 
dedicated proponents of career education invariably had the best projects — charac- 
terized bv interesting approaches, novel departures, and enthusiastic participation 
(see Kastplace and Midville) 

The importance ofthe principal's support was clearer in the staff development 
projects Teachers' abilitv to carrv out the lessons acquired in training depended on 
the attitude of the principal. In Dodson, for exampte. where strategies of individuai- 
i/ed instruction were sometimes interpreted as "un-American/' principals of\en 
opposed the ' mges encouraged by the staff development project Although trainees 
were o^tensio' nteers. many teachers were "volunteered" by their principal for 
partfcipation in u.c- project. The project leadership had wanted to work initially with 
a group of ♦eachers who woul^T3e"^tnost receptive to the project s-behavioral obiec- 
lives \et man> principals sent teachers who were their favorite disciplinarians, or 
theii worst teachers. And once "trained." it wms extremely difficult for a teacher to 
sustain new technique^. if the principal did not modify his evaluation standards and 
did not support the teacher in a distinct departure from school norms. 

Other, less subtle, instances of principals' opposition were observed in Dodson. 
dissenting teachers were swamped with problem children, one group of teachers who 
expressed an int^ est in team teaching was exiled to temporary wooden buildings 
separate from the rest ofthe school (referred to as "the snacks" by the other teach- 
ers); teachers were burdened with new extra duties. 

Not surprisingly, administrative support was most important in highly complex 
|)rojects which attempted to implement substantial change in existing practices. In 
these projects, explicit support from district administrators often carried them 
through the uncertain first years and. conversely, few of these projects seemed able 
to survive administrative indifference or opposition 

Experience with Innovation 

Prior experience with innovation appeared to affect the course of change agent 
projects. F'or example, projects which were an extension of existing district practices 
leg.. Sandwood) or which were built upon the past experience of project persorne! 
leg , Dodson. Eastown, Adamstoniall had h^^s difficulty in implementation tliaii did 
similar projects elsewhere, and tended to make grea*^er headway in the first year 
than did projects that w^-e novelties for most ofthe participants. 

District experience with innovations also had an pir^ct. Districts which we con- 
sidered to be "innovative" (see Vol. II) generally displayed a greater tolerance for 
failure and uncertain start-up (see Centerville) and showed greater flexibility in 
dealing with unanticipated problems or project requirements (e.g., Sandwood). As a 
result, project staff in these districts did not appear to feel pressure to produce 
immediate "significant results": problems were solved before they became crises; 
aial project personnel felt free to propose appropriate solutions or strategies even 
when t. .y deviated from original proposals (e.g., Centerville, Midville) 

However, in some instances, propensity to innovate in a district was also seen 
to hamper implementation efforts. In some ofthe districts we visited, several innova- 
tions were underway simultaneously A number ofthe career education projects 
experien -ed teacher attitudes of "not another innovation!** For example, in East- 
place teachers were at first quite opposed to career xiucc«tion because they were 

trr- 
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^Tiierally U i up with innovations and with all of the associated upset and extra 
work One Right-To-Read project was 'n a district which had already mandated 
wholesak changes. Right-lVRead objectives added yet another request for change 
to already overburdened teachers, many of whom consequently elected tu ^,!ight 
Right-Tu-Read directives. Likewise, in one ofthe open-classroom projects (Eastown) 
the project director believed that the commitment of one ofthe project principals 
to experiment with a reading package in his school conflicted with the project 
director's own objective of focusing project activities on project-developed materials 
In general, the problems c^iused by competing innovations were less severe in 
the more complex projects, many of which encompassed all activities of schools or 
classrooms. In the ancillary projects, however, new projects starting up simultane- 
ou.^ly in the district sometimes led to shifts in the district staffs interest and priori- 
ties that eroded the attention given to change agent project implementation. 



Unanticipated Events 

Practically no change agent project we observed progressed through a course of 
nplementation without having to respond at some point to an unanticipated situa- 
tion—some relatively tri\;al and others momentous. The ease with which projects 
responded to these "shocks" in their plans and objectives was related both to the 
flexibilitv of their project design and personnel, and to the 'nnovativeness ofthe 
district and its commitment to the particular project. 

For example, the Brickton project was disrupted by events in the district. The 
main activity of Phase I of this project was the administration of a comprehensive, 
locally develop«^d criterion-referenced test. The Brickton city government, however, 
had put a freeze on the use of outside contractors, so the project staff members had 
to fiud another way to print their tests. They chose to have the tests printed by 
students in the districts vocational education programs, with disastrous conse- 
quences for the project. The student printers printed the wrong version ofthe tests, 
with errors, and in insufficient numbers. The project also ran into trouble trying to 
get the seven million testb properly distributed through the newly reorganized 
school system. 

Just when it appeared that the project s printing and distributional problems 
with the tests might be over, a cityw^ide teachers' strike brought testing to a halt. 
Alter the strike was over, the superintendent ordered all Right-To-Read project 
activities to cease f the remainder ofthe vear. His feeling was that the teachers 
were so sensitive th . they would not be receptive to trying new things— in particu- 
lar Right-To-Read, which was identified as the ''superinte: ^lent s project." 

These events would have represented a setback in any project, but they were 
disastrous in the Brickton instance because ofthe poor communications between 
project i.taff and classroom teach: rs. For example, the failure to explain to teachers 
that the problems with the tests were the result ofthe city government decision gave 
teachers the impre^^sion that Right-To-Read was totally disorganized, baoly run, and 
ineflectiye. The lack of communication was compounded by the teachers' sti ike. The 
teachers' attitude toward the superintendent and their disputes with him over pay 
created an atmosphere in which Right-To-Read mistakes were misrepresented and 
blown out of proportion. The project staff is not optimistic that the bad image of 
Right-To-Read in Brickton can be improved or that initial momentum and en- 
thusiaoin can be recaptured. 



Events in .the district also forced the Dodson Title VII project to modify its 
acti\ itie.^ in midstream. Th\> bilint;ual education project began as a totally Mexican- 
American program, operating in three schools In 1972, t\so years after the program 
begi.n. a new district integration policy forced the program to restructure oper- 
ation.s. Integration in Dod.son wa.s accomplished by grade-level reassignments be- 
tween black and brown schools (the latter had been ofliciallv identified as white 
bchools). With this reorganization, the project target population was spread over six 
schools, and non-Chicano students appeared in pioject classrooms. The consequence 
was dilution of project staff'effbrts as the same stafftried to cover six schools instead 
of three, and the effective doubling of classroom efforts a.s non-Spanish-speaking 
children were added (i e., the addition of blacks requin d that project staff^attend to 
the teaching of Spanish as a second language as well as the teaching of English to 
S[>tinish-speaking children) However, with the support of the district and a flexible 
project staff, this project managed to weather these problems more or less gracefully. 

Not all disruptions in project plans are related to "outside" events For example, 
m ( enter\ ille. an attempt to extend the classroom organization project to the junior 
high on a pilot basis, during the project s .second year, met with complete failure. 
During the third year, a completely redesigned program was installed in the junior 
high, consistent in objectives with the elementary pioject but quite different in 
technique This revised program achieved a significant degree of succes.s, even in its 
first year. 

In sum, unanticipated occurrences in the course of project implementation were 
alwavs disruptive, but projects which had district support, flexible personnel, and 
good communication with their staff seemed to be able to meet these disruptions 
without great cost to project effectiveness 

Summary 

The following attributes of the institutional setting were observed to influence 
the implementatioi of the change agent projects* 

• Degree of administrative support and commitment 

• Past experience with the particular innovation 

• High propensity to innovate 

• Administrative flexibility 

• Good communications 

All of these elements relate to organizational climate— and the extent to which a 
district supported change efforts generally and a change agent project specifically. 
However, because of the project focus of our fieldwork, we could not identify other 
<ispects of the institutional setting which were consistently or significantly related 
to project implementation. 



IV. PROJECT OUTCOMES 



We have already discussed our concept of project "success." In this section, we 
will use that fraipework to describe the types of project outcomes we observed, an J 
to describe those elements of the change agent project or institutional setting that 
appeared to contribute to differences in project outcomes in the sites we visited. 
Specifically, the following subsections will be concerned with the impact of the 
project on the district (i.e., classrooms, teachers, and students), and the impact of the 
federal seed money on educational activities both inside and outside the LEA U e., 
project continuation and dissemination). 



IMPACTS ON PARTICIPANTS 

Impact on Classrooms 

The change agent projects we observed generally did make a difference to life 
in the classroom— in the atmosphere of the rooms, the curriculum content, and the 
teaching techniques and resources. 

Classroom changes were the most pronounced in the classroom organization 
and staff development projects. They usually involved more openness and informal- 
ity, more flexible and varied use of physical space; more evidence of self-expression 
and student-initiated work; more individualized programs. Classroom changes were 
most apparent where the projects provided teachers with some form of classroom 
support, in the way of technical or administrative assistance, which complemented 
the training and/or materials development phases of the project (see Appendix A 
for details). 

In the projects we visited, classroom effects were greater in the lower grade 
levels. Clcissrooms with young children oflen showed dramatic project effects. 
Changes in the higher elementary grades were much less dramatic, while those in 
high schools were almost negligible. In a number of sites, high school classrooms 
were oflicially dropped from projects afler experiencing severe initial problems in 
implementing project treatments. 

It seemed to us that a number of Cc;uses acting together may have increased the 
obstacles to short-run change in upper grade classrooms. First, younger children are 
thought to be easier to teach, and more open and responsive to changes in learning 
style. Older children have already been conditioned by their previous school experi- 
ence to expect a certain environment. For instance, staffof the elementary school 
open-classroom projects believed that students who have been long exposed to more 
traditional teaching styles are less able to respond, at least initially, to opportunities 
for greater openness, expression, or responsibility than their younger schoolmates 
who liave not yet been so conditioned. 

Also, as mentioned in Sec. Ill, upper grade teachers often tend to consider 
themselves subject matter .-^pecialist:>, and to resist attempts to insert nontraditional 
subject matter (like reading, career education, or bilingual culture) within their 
specialty Our fieldwork suggests that appeals to consider the whole child are appar- 
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entl> lebb effective with a teacher who is alread> worrying about only one small part 
'language arts, bcience. math, etc.) than with a teacher who must work with the child 
on a variety of .subjects 

Furthermore, changes in one part of the curriculum seldom affected other 
parts, even when subjects were taught by the same teacher. This characteristic of 
narrowly based curriculum change projects was especially evident in the reading 
projects we studu^d. But we also observed it in math (math labs) and career educa- 
tion. Change agent projects which focused on only one part of the curriculum seemed 
oflen (o be captured by the very specialists who most needed to adopt the changes 
they resisted. 

Impact on Teachers 

An innovative project might affect participating teachers in a number of ways. 
At the simplest level, it might change the technique or materials used by the teacher 
m accomplishing given learning objectives. It might change the techniques or policy 
used by the teacher to run her classroom or the relationship she establishes with 
her students. At a more complex level it might change the teacher's priorities or 
\alues as to what is important for her to cover or for her students to accomplish. 

Finally, her experience in an innovative project might change a teacher s atti- 
tude toward her job and profession. It might change her impressions of her own 
teaching effectiveness and her interest in improvement. 

Some bilingual projects we observed resulted in little change in teachers, since 
they relied primarily on replacements or supplements for the existing staff Incum- 
bent teachers were not required to make substantial changes However, in other 
instances, more far-reaching organizational changes such as team teaching or open 
classrooms were made as part of the bilingual project. 

.Although in theory the reading and career education projects sought considera- 
bly more, the projects we visited resulted in changes of (Hily the simplest type— in 
materials and cu rriculum content. Many of the projects were said to use new materi- 
als in the same old way. Rarely did the projects challenge the teachers' relative 
vaiues about different subjects or their views about their own roles in teaching and 
learning. 

We found that the classroom organization and staff development projects pro- 
duced much more pervasive results among the teachers. In many cases, the project 
experience changed them profoundly. These effects were somewhat surprising, con- 
sidering that many of the sessions were brief, and that project efforts generally did 
not rub off on the untrained colleagues of project teachers. In many cases, the change 
agent programs were an unexpected but essential catalyst of behavioral change in 
teachers. 

This impact may have been due partly to the higher status, greater financial 
rewards, or greater contact with colleagues that change agent projects oden pro- 
duce In nriny of the projects involving substantial change in teachers, there was 
an obvious increase in colleagues* support and solidarity resulting from their com- 
mon trials. Success in effecting change in teacher behavior was considerably higher 
m ciassrouin organization projects than in projects which relied on staff development 
alone 
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Impact on Students 

Project impact on ytudenli> has traditionally been the focus ofmost evaluations 
of educational innovations.JIowever. as we have discussed, tfie focus of this study 
vvas not "evaluative" in this sense but instead attempted to understand the process 
of change. Consequently, our research was not designed to measure the mipact of 
change agent projects on student achievement or attitudes. Thus, the discussion that 
follows relies on evaluation data made avaiiuLIc to us by the projects we visited, as 
well as evidence we gathered in interviews with school staff, parents, and other 
members of the community. 

The classroom organization and staff development projects we studied did not 
take higher achievement scores as their primary objective. In fact for some projects, 
the districts expected achievement scores to drop off a little in the first year or so 
because of the confusion and turmoil of implementation. On the Whole, these pro- 
jects reported no significTint changes in student achievement; one or two showed 
some slight gain, and an equal number, a slight decline. The most striking changes 
attributed to these change agent projects were in student behavior and attitudes. 

In the classroom organization projects, the schools reported declines in absen- 
teeism, behavior problems, and referrals to programs for the mentally retarded A 
number of parents claimed that their children showed more interest in school and 
more self-control, confidence, and direction as a result of project participation. 

Staff development projects had similar kinds of outcomes, although far smaller 
in degree. Staff development projects were usually less intensive than classroom 
organization projects, and their effects on students were more diffuse, since training 
activities were not tied to project-sponsored classroom changes. 

We were able to gather little evidence on the impact of the reading projects on 
students. Only one of the reading projects we observed had a completed evaluation 
that could be used to determine achievement gains. The evaluation of this highly 
structured diagnostic/prescriptiveTitle III project showed that while decoding skills 
were improved, reading comprehension was not. Methodologically, most of the 
Right-To-Read evaluations were exceedingly weak, compared to those for the Title 
in reading projects. The data contained in these evaluations seem to indicate only 
slight marginal effects. 

It was even more difficult to assess the effects on students of the bilingual and 
career education projects. There were no good baseline data to use as a basis for 
measuring changes in the performance of children in these projects. The best that 
could be done was to indicate how much time students were exposed to the project s 
teaching material. This exposure was much greater for bilingual projects than 
career education. Bilingual project students did receive a substantial exposure to the 
particular language and culture which was the focus of the project. In career educa- 
tion projects, young students regularly r*eceived increased exposure to career aware- 
ness material. In higher grades, those few students who were sufficiently motivated 
to seek them out obtained increased counseling services or access to work experience 
p rojects. 



CONTINUATION 

Continuation of federally sponsored pr ejects is usually thought about in indivis- 
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ible and institutional terms ' That is, a project is considered to be "continued" afler 
the withdrawal of federal funds if the original "package" or "program" of goals and 
treatments is carried on at some level by the local school district. Bat our fieldwork 
suggested that continuation is not such a straightforward question, nor is it always 
the result of fbrnja! district decjsions. We observed that continuation could be 
defined to include persistence of tlk' project at different levels of effort, it could also 
mean continuation or incorporation of elements of the project that were adapted to 
suit local conditions 

In addition, although it is usually assumed that decisions about continuing or 
terminating projects are made at the district level, we found that this was not always 
the case. While decisionb to provide more funds for the project were normally made 
"downtown." incorporation of many innovative strategies did not always require 
formal institutional adoption. For example, some innovative technologies or class- 
room practices were expected to be continued by individual classroom teachers 
without an> fbrnuil project affiliation or district sanction Our fieldwork suggests 
that research that has queried only superintendents or project directors about pro- 
ject ct)ntinuation may have underestimated the effects of federal seed money. It is 
difficult for a district administrator to know about incorporation at the classroom 
level, indeed, in larger districts, a superintendent may not even be aware that a 
federally sponsored project has been continued under a different funding umbrella, 
with a different name 

In our experience, teachers often continued to carry out project strategies, at 
least in part, afler federal funding ceased— particularly in the classroom organi 
/ation and staff development projects. These individual decisions are the most diffi- 
cult to identify and track down when "decisions to continue" are tallied. These small 
changes resulting from change agent projects do represent a positive return on the 
federal investment in educational change. 

Many of the projects we visited were still receiving federal funds, and had not 
yet ser iously confronted t he question of continuation. Therefore, some of the sugges- 
tions generated by our fieldwork are based in part on expected continuation activities 
—what, in the opinion of major participants, is expected to happen afler federal 
funds are withdrawn. But the gap between expectations and future reality may be 
large. Subsequent research of the Rand change agent study, which will focus specifi- 
cally on issues of continuation, should provide data which can support or amend 
implications we have drawn in the first year of the study. 

Continuation of Program Goals and Practices 

Continuation or incorporation had a somewhat different meaning for each type 
of piuject we examined. For the Title III projects that attempted to promote change 
in classroom organization practices, continuation meant maintenance of child-cen- 
tered, individualized, and nontraditional instructional methods Teachers continu- 
ing project activities would be expected to go on with group or individual instniction, 
U) support increased student responsibility and decisionmaking, and to organize 
their classroom activ ities in a way that acknowledges individual student differences. 

' StH' Nnnnan lUwrn, Tlu' Ailoptum lUtvoi Title IH Innoxations aWci the Knd of Fedoral FuiulinK,*' 
Editnthimal 7V( hfi<»/o^\. Vol 10, Novombei IW). Ahthorn N Potomtni, ' A S!u(l\ ofTith' III Projects 
MWi Approved Fundinjr F.ikK." Ph 1) diss. Schm)! of Kdiiaition. St Johns l;ni\erMty. VM) 
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Continuation or incorporation of staff development projects took two forms: 
persistence of the stall training activities sponsored by the Title III project; or 
continuation of the changes in staff behavior that were promoted by the training 
projects. 

The reading projects would be judged as "continued" if the district supported 
the special reading services (labs or special stafl^ started with federal funds, or if the 
general approach to teaching reading advanced by the project became part of the 
districts (or teachers'l standard practices. 

Because of their nature, continuation of bilingual education and career educa- 
tion projects has to be viewed primarily in institutional terms; that is, these projects 
would be "continued" if, afler the withdrawal of federal funds, identifiable bilingual 
cr career education activities persisted in the district. 

Patterns of Continuation 

Despite the different objectives of these change agent projects, and despite the 
somewhat different meaning"continuation"has in each instance, clear and consist- 
ent patterns of continuation appeared to exist across the projects we visited. 

Replacement vs. Add-On (or Training vs. Technology). We found that, on 
the whole, projects which attempted to replace current practices were more likely 
to be continued or incorporated than were those projects which represented add-ons 
to existing strategies. For the sample of projects we visited, almost all of the activi- 
ties which replaced current activities included training activities; almost all of the 
add-ons were technologies or products. Thus it may be that the nature of the project 
focus (i.e.. training vs. technology) contributed significantly to its incorporation. At 
this juncture we do not have enough data to be sure. 

Fo»* example, to the degree that the project t reatment 'Hook" effectively, innova- 
tions that included teacher training or staff development activities have been incor- 
porated or continued almost without exception. All of the classroom organization 
projects (which attempted to change teacher attitudes and behavior from the tradi- 
tional to the informal or open approach to learning) have been continued, or are 
expected to be incorporated to some extent. Participating teachers reported that 
they "could never go back" to traditional classroom roles and behavior. 

Similarly, successfully implemented staff development projects seemed to ex- 
pect little backsliding in teacher behavior. Thus, although almost all of the staff 
development projects will formally end with the withdrawal of federal funds, there 
is evidence that these projects will be "continued" in the sense that the changes they 
hoped to promote will be incorporated into the behavior of many participating 
teachers. 

But it is worth noting that classroom organization projects produced more ex- 
tensive and consistent changes in staff behavior anu attitudes than staff develop- 
ment projects did. A likely explanation is that the training component of classroom 
organization projects was intimately tied to meeting project objectives. Participant^: 
needed this training in order to meet their day-to-day assignments and the expecta- 
tions of the project director, principal, and others. The staff development activities, 
on the other hand, were often not focused on a particular short-run objective or tied 
to some current school activity. They were more of a "general enrichment** for 
classroom teachers who were eager to change their teaching methods. This sup- 
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gebted to us that the stairdevelopmont projects might be more effective if'they could 
be tied to more explicit requirements or program objectives. 

One staff development project in the fieldwork sample contrived such induce- 
ments m two ways. First, the project stafi'w^on district acceptance of their training 
program as a qualification for a higher t>tep on the district's pay scale Second, when 
the SEA required all districts to come up with a new set of performance standards 
for recertification of their faculties, the project^^ff successfully inserted their 
project's own list of desired teacher outcomes. Cons^uently, all the teachers now^ 
have an mcentive to pay careful attention to those standards, and the project does 
not have to rely heavily on teachers' intrinsic motivation to change 

P^xperience in the reading projects we visited provided further support for the 
suggestion that staff training tends to "stick" when tied to classroom practices, while 
most of those activities that were undertaken in addition to the teachers' usual 
c/assroom practices have been, or are likely to be, dropped when special funding 
ends. For example, training in the diagnostic and prescriptive approach to reading 
has taught many teacher.s that (different students learn to read in different ways, and 
that teacher& can teach to these diflerences. As a result of the reading projects, some 
teachers have moved away from broadly classifying students as "slow" or "fast" 
readers md have begun to diagnose specific deficiencies in such areas as word attack 
or decoding &kills. These behavioral changes, which comprise an approach to the 
teaching of reading las opposed to a specfic strategy or technology), are expected to 
continue. 

Those bilingual and career education projects which simply added new activi- 
ties and materials to a district's repertoire, but prov ided little (if any ) developmental 
training for staff,^ seemed unlikely to be continued or incorporated unless states 
mandate some type of program, as they now often do for bilingual education. The 
state sometimes continues to pick up the tab for add-on projects, particularly for 
career education. The use of add-on materiai*^ appeared to wither away in the 
absence of active encouragement of a project staff and explicit participation in a 
project. It seems likely that when special project status and staff go away with the 
last federal check, these additional materials will be put back on the shelf. 

Initial Commitment and Priority. A second pattern or generalization that 
emerged from our field experience concerned the relationship betw^een eventual 
continuation or incorporation and initial support. That is, decisions about project 
continuation appeared to closely parallel (or could be predicted from) the decisions 
or motivations to initiate the project Projects which were initiated with strong 
district support and which were also seen as a solution to a particular problem were 
incorporated almost without exception, albeit at varying levels. And without excep- 
tion, those projects which represented an opportunistic response to available dollars 
and received Uttle or no support from di.strict administrators withered away, even 
irhere project objevtivcs were met. 

Also, it was generally true that where projects did receive district support and 
were seen as solutions to recognized problems, the district probably would have (or 
already had) undertaken the project activities anyway. In our sample of projects, 
federal dollars were not used to test a new idea, or experiment with an innovation 

l-oi litic \ 11 projects, .i spcual tontinuation piublcin ih LOtitaiiuci in the turd to ttain monolm^nial 
t^'.u'lu'rH ill a sfcond lanK'uaKt'. or to add additional i)ilin^nial staff to the legular proKrani 
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strategy. Instead, these funds served to speed up or expand the implementation of 
innovative practices to which the district was already committed/^ 

To this point, the experiences of a number of the career education and Right-To- 
Read programs we visited illustrated the slippage that often occurs when a problem 
is identified at the federal level (i.e., reading, career education) and the resulting 
••solution" is "imposed" on local districts. F^or example, because Right-To-Read dem- 
onstration projects were funded even before project proposals were submitted, some 
districts saw Right-To-Read money simply as a grant-in-aid. These LEAs used the 
federal dollars to fund their own priorities, even when they conflicted with the 
Right-To'Read program guidelines. And in the absence of effective federal monitor- 
ing or because of oversight, there was little that federal oflicials could do to remedy 
the situation. 

An almost axiomatic lesson that emerged from our field experience was that 
people change more easily when the change helps them solve problems that are real 
to them. Projects that were expected to be incorporated into district practice were 
usually based on the staffs ovei^riding sense ofeducational necessity and the signifi- 
cance of the program and the proposed remedy. Our field experience implied that 
although categorical, targeted programs may be intrinsically more satisfying to the 
federal policymaker concerned about the national dimensions of a problem, it is 
unlikely that these programs will lead to much change unless the programs^ aims 
fit local interests and priorities. 

Our experience suggested that where local and national priorities are not con- 
gruent (as in some of the career education and Right-To-Read programs), federal 
intent is likely to be subverted to local interests, local administrators will simply 
take advantage of available opportunities, and the project will probably have little 
or no long-term impact. In our fieldwork sample of change agent projects, federal 
dollars were used most effectively when they were used to support locally developed 
solutions to locally identified need?. 

Project staff also offered other explanations for expected continuation or lack 
of contin'-ation, which can be partially understood in terms of initial district com- 
mitment to the project goals and activities. For example, many districts cited "cost'' 
as a reason for not continuing federal change agent projects. However, we saw 
examples of projects which surmounted cost constraints because districts thought 
the project was important- In two ofthe classroom organization projects, extra costs 
were met by reallocating district resources. In the remaining classroom organization 
projects, individual teachers elected to ''cope" without aides in the classroom be- 
cause they were convinced that open-classroom practices helped their students. In 
one Right-To-Read site, where the superintendent had identified reading as a district 
problem, the extra costs were absorbed by juggling the district budget level. 

This is not to argue tiiat cost is no obstacle for districts wishing to continue 
particular project activities. Rather, our case studies suggest that ''cost'' constraints 
may sometimes be a red herring, drawing attention away from the fact that a 
particular project-respite its relative merits or successes— was not continued or 
incorporated simply because it did not represent a hi^h priority for the district:' 

* II pushed to Its lo^Mcal conclusion, this observation can lead to a (somewhat extreme) recommen- 
ition that the fedeial go\ernment not (uiui distiicts (or special pui poses. becaus(^ local districts tend 

to do what they want to m any event 

♦ Cost probabl V is not a red herring' but a genuine constraint in career education projects Itatht r than 
relying on teacher-produced material, most projects utilized some form of outside enrichment like held 
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Similarly, we also observed that thot^e innovations designed or stalled by "out- 
siders" isuch as consultants or special teachers) were usually not well implemented 
and were usually not expected to be continued or incorporated. In the projects we 
visited, local involvement and sense of ownership in the change agent project ap- 
peared to be important to both implementation and continuation efforts. 

We have not discussed student outcomes as a factor affecting continuation. In 
the projects \\e visited, project evaluation evidence did not seem to play an impor- 
tant role in decisions to continue or incorporate project strategies. Where project 
outcome data were used to support such decisions, they were apparently applied to 
justify a decision that essentially had beenmadeon other grounds. For example, one 
Hight-To-Read project will be continued because the superintendent is highly com- 
mitted to the project focus and treatment — even though there is now no objective 
evidence that participation in the project does anything for students' reading scores. 
Another RightTo-Read project (Adamston) is unlikely to be continued even though 
It has shown dramatic gains in reading readiness skills and reading decoding skills. 
District administrators cited lack of effect on comprehension scores as a reason for 
probably not continuing the project. 

In sum, we were struck by the absence of reference to evaluation outcomes in 
the project sites we visited. On the whole, district and project staff appeared to view 
evaluation as a necessar> ritual, which was tied to the continuation of federal funds 
but was not important for their own continuation decisions. 

Summary of Factors Affecting Incorporation 

We observed a number of factors which appeared to be related to the incorpora- 
tion or continuation of federal change agent practices afler the withdrawal of feder- 
al funds. 

FACTORS PROMOTING INCORPORATION 
ClHiractenstics of the Innovation 

• Congruence with formal and infbrmal district goals and priorities 

• A dominant staff training component 

• A focus on project activities that were intended to replace (rather than add 
to) current practice 

• Locally initiated project design and material development 

Characteristicii of the Im^titutional Setting 

• A high level ofcommitment and support on the part of district administra- 
tors 

• Active consumer demand (n b. Title Vli) 
External Fac/ors 

• SEA or federal priorities consistent with project goals and treatment 

Mjtuitllv (it»p(»iui(»i\t on continiu»(i outside supix)it 
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FACTORS INHIBITING INCORPORATION 
Chanwtmstu'H of the Innovation 

• Cost 

• Targeted or categorical program goals or treatments 

• Add-ons to current district practices 

• Externally developed materials; heavy reliance on outsiders for technical 
assistance in program design or implementation 

• Lack of congruence of project objectives with local needs, priorities, or 
values 

• Special staffing requirements (e.g., bilingual teachers) 
Characteristics of the Institutional Setting 

. Low level of district administrative commitment to the project 
« High level of staffer administrative turnover 

• Absence of consumer demand 



DISSEMINATION 

From the perspective of federal policymakers, one of the most important Ixrx- 
tions that change agent projects can play in the reform of educational practii. is to 
disseminate successful ideas and activities both inside and outside of the .'^strict. 
Subsequent research of the change agent study will focus more explicitly on ques- 
tions of dissemination. Only a small number of the projects included in this year's 
work were actively engaged in dissemination activities. Consequently, the sugges- 
tions and interpretations offered below should be viewed as tentative. We expect 
that they will form the basis for developing working hypotheses to guide further 
analysis. 

Intra-District Dissemination 

What is notable about intra-district diffusion of change agent project strategies 
and materials is how little of it there was. This is most understandable for career 
education projects, which required special materials and curricula and were there- 
fore unlikely to be picked up by nonproject classrooms in the districts. Most disap- 
pointing, perhaps, from the perspective of federal planners, was the absence of 
diffUbion of Right-To-Read strategies in th^ ' »monstration sites. 

Federal expectations for intra-district dissemination were most explicit in the 
instance of the Right-To-Read demonstration projects. Part of the Right-To-Read 
model included designating a project school as an "impact site." Impa<rt sites were 
to be schools that already had effective reading programs and could therefore help 
other schools improve their reading programs. We were unable to locate ? single 
instance among the sites we visited when an impact site provided any substantial 
assistance to the other project schoors: we saw only one school that picked up an idea 
'from an impact school. (That idea was to establish a reading resource center ) 

Title VII bilingual projects were the most widely disseminated within districts. 
In the three big city project sites, Title VII projects have had a major influence on 
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till* dovelupmenl o( other (nt)n-Tille bilingual projects within the district TitU* 
Ml [)iojfCt> in these (list r ids shaied the ht'nefils oCsl all' training proj^rams. niana^o- 
nient expei icnce. locall\ developtnl materials, and did'erent 'instructional ap- 
proachOis isuch as variations in slallin^^ patterns and pu[)il sch^duHn^o. 

With the exception ofWa^^onia. the Title III stalI'deve!o|)nient projects denion- 
stiatfd no iiitia-disttict dissemination. TheTitle III classroom or^Mni/ation projects 
contained ?e\eral somewhat different instances oC intra-distnct didusion. 

In (Vntetville. the project tried to implement a new^ approach to education 
within tlie district Almost every new administrative post in the district was filled 
b\ >ttil[* members with project experience Parents were openly enthusiastic about 
the qualit\ of the pro^n-am. The onl\ rt.^isons that the project hadn't spread to all 
classtoonis were the hmits placed u^. tl'i^ use of funds b\ the ^rajit (50 percent of the 
elementar\ student bods' and the belief of the superintendent that the district 
should offer several alternative prourams. It was riot surprising, ther-efbrv. to find 
nuin\ pr-oject teacher-s adoptin^^ the classr'ooni techniques espoused by the pr-oject. 

In Kastown. open-classroom pr*actices werv clearly making their way into non- 
project schools, This inti'a-district diffusion had two sourxes. The pr*oject ran a 
tr*aininu |)rH)gr'am for student teacher's at a near'by uni\er-sity. and teacher-s who 
would .^uhsequentls be employed b\ the district implemented open-education strate- 
^^les m their ciassr-ooms. The district administration supporled this pr*oject and 
pr-ohably tried to r*ecruit pr*oject-t rained teacher's when it was hiring. 

Second, the pr*oject oper*ated a tr*aining pr'ogr*am for teacher-s and one for princi- 
pals inter-e.sted in the concepts and str*ategies of open education. Although most of 
the participants in this pr*ogr*am came from outside the district, it also affected 
l^a^town staff For example, one Eastow n elementar*y school principal whowaspar-t 
of this groU[) was in the pr*ocess of changing his schoofover from traditional to open 
clas.^rooms The effect on participating teacher's wa:- less dr-amatic — particularly if 
the\ worked in a school in winch the principal did not su[)po.t open education 
Nonetheless, participating teacher's reported that their practices wer*e changed by 
the tr-aining pr-ogr-am 

In Sandwood. pr*oject staff'ofthe multiage gr*ouping pr*oject pointed to schools 
m the district which werv moving towar*d opi^u education and suggested that their 
|)ro|ect i)la\ed a par*t in this change But this connection was not clear to us. Other 
schools in the district didnl pay much attention to the pr*oject, and we suspect that 
dn\ nioVe the\ made toward open education resulted niorv from the national promo- 
tion of theo[)en-school appr;oach than frorf^ the presence of the project in thedistrict 
Itowesei. witlnn project schools, project si r*ategies wer*e adopted by nonproject class- 
rooms In most of the 19 pr-oject schools (each of which contained one pr*oJect class- 
room', teachers could point to colleagues who began to implement multiage gr*oup- 
mg and open-education concepts 

The [)rincipals* attitudes played a significant [)art in the extent of thisdiflusion 
m Siirulwood In those schools wherr princi[)als did not support o[)en education, 
there was little diffusion, despite expressed staff interest Ikit whervver principals 
endoi^ed the project, nonpi'oject classrooms wer*e mor-e likely to adopt pr*oject pr*ac- 
tices A number of princi[)als even supported project diffusion to nonpr*oject class- 
r*(M)nis with the aid of the schools discr-etionarw fund, or applied for district funds 
to rno\e wall^ or hu\ special pr*oject materials for intervsted teacluM's. 

lUa these wer'e the exceptions B\ and lar-ge. nonproject personnel in thedistrict 
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paid little attention to the change a^ent projects. This apparent indiflbrence seemed 
to ^tem irom an unwillinKnoi^j^ lo acknt^v.led^e the accomplishments oftheir neigh- 
bors or to admit that i>omeone else in the district with roughly the same problems 
and resources was doing a more eirective job. Project staff'also reported that other 
teachers and principals in the district saw the project as a threat. 

Doing "something diH'erent"* requires extra work and time, particularly at the 
outset, in the view of our respondents, their colleagues feared that they, too, would 
be expected to work harder and thus ignored exemplary or innovative programs 
operaUng in their district, alleging that the project had special resources or that it 
dealt with a different student population and so would not "work" in their own 
setting." The bilingual proje^ ♦s cited above were not really an exception The bilin- 
gual projects were not threatening as "innovative" or "exemplary" projects. Instead 
they offered technical assistance to educators who had to implement similar pro- 
jects. 

Inter-District Dissemination 

Our sample provided few instances upon which to base conclusions about the 
relative effectiveness of efforts to disseminate project strategies outside the district, 
or about how the effect of dissemination efforts could be evaluated. Only four of our 
projects Uwo classroom organization projects and two career education projects) 
were activelv and explicitly engaged in dissemination outside oftheir own districts. 
Conseciuently, the following suggestions must be seen as tentative and speculative. 

Until quite recently, the low^ diffusion rates of educational innovations were 
usually explained primarilv in terms of inadequate information. This explanation 
generated what has been called a "Rational Man'* research and development strate- 
gy, which assumed th»t if educators only had information about more effective 
educational strategies or technologies, they would adopt them. Another common 
explanation is that the new educational technologier. arenl good enough. In re- 
spon>e to these beliefs, federal agencies and private firms have developed packages 
and technologies which could be applied wholesale to school district operations. For 
example, these packages are often designed to be as **teacherproof"as possible, so 
that innovation won't have to depend on teachers' attitudes or behavior. 

Our fieldwork experience called into question some of the assumptions of this 
theoretical approach, and the resulting emphasis on more information and pack- 
ages -'irst. we saw no real evidence that lack of information or the perceived absence 
of we i-developed technologv were important barriers to innovation at the local 
level W»» found thJU the dominant reason was lack of interest in change, and a 
consequc..* h\ck of demand for innovative practices Wherever there was demand, 
people soug c out information, found it. and used it. Where there was no demand. 
It did not seem to make any difference wh<nrer information was present or absent. 

Second, our observations suggested that the packaged approach to promoting 
change at the local level underestimated the importance of prior local interest in 
change, and also failed to acknowledge the importance of local involvement in 
project development, as described in Sec III of this volume. For example, locally 

Ihis tmdinK U>v. mtradistrjct (lilluMon is tonsis^.n! svith the conciusion of evaluatOiJ- 

assessing tlu« unpad of the Foul Foundatioii LiKbthousc projects KiKhthou.se projects, it vyas discovoml. 
Ka\( lntio Kuuiance to the pracnce> m th(» home district Like the projects \n our field WMupW, the 
Ford spon^oied denionsttation projects were <iirnosl totally i^noted bv educators in their diHtiict^ 
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developed materials appeared to be much mote ef[ecti\el\ utilized aud to contribute 
more to the uccess of a project than packaged approaches buch a.s Individually 
Pro^M*ammed Instruction and Southwest Re^Monal Laboratory materials. In the pro- 
ts we visited, local involvement promoted a sense of "ownership" and pride, and 
..u'>o K'iive participants an opportunity to think through [)roject philosophies and 
strategies in concrete terms. 

Also, materials or plans developed outside ofthe district tendea to be viewed by 
local personnel as "foreign imports." Similarly, districts oflen rejected advice from 
outside consultants because they failed to consider the special problems of local 
schools and students. The Right-To-Read experience suggested that even those 
"packages" which were essentially managemc olanning strategies did not seem 
to be as effective as planners hoped, because they nnd an alien flavor and because 
they oflen were not flexil;le enough to accommoda^ lucal contingencies or crises. 

The repouedly successful dissemination strniegj v/e encountered were struc- 
tured so as to reduce the perceived threat and the perceived irrelevance of "exem- 
plary" projects. These projects sent traveling teams (which in the classroom organi- 
zation projects included parents as w**ll as teachers and administrators) to districts 
that had expressed interest. These traveling teams tried to help local districts design 
and implement their own projects and did not tell them what to do in detail. In other 
words, they tried to help districts build their own innovati/e capacities, and did not 
try to install a replica of their own model. 

Change agent project staff felt that this "traveling circus" approach worked 
much better than visits to the innovative project from the staff of other districts. 
Visitors to a demonstration site seemed to feel threatened. They oflen saw the 
accomplishments o^'the project as "overwhelming.*' For example, visitors remarked 
that the> couldn't imagine how the project could be carried out in their own district. 

One project director pointed to another problem wath reliance on visits to an 
exemplar} sitv'. He found that teachers who had spent time interning in his program 
were unable to implement project strategies upon return to their home district 
because of lack of support from their principals. He believes that a traveling show, 
which reaches principals (and oflen parents) as well as teachers, is able to generate 
the necessary support for an innovative practice. 

Our fieldwork suggested thai site visits to an exemplary project couid be help- 
ful, but usually «/Verthe change agent staff had first visited the adopting district. 
The dissemination staff seemed to be most effective when they described particular 
problems and framed their advice not just in terms of "how they did it in Our lowm," 
but also dis<*ussed how it might be done in light ofthe problems that the adopter 
faced/' 

It is important to note that these dissemination activities did not take place in 
a vacuum but in response to an explicit demand, stimulated by SEA or USOE 
priorities In one state, new early childhood education legislation awarded money 
todistrictsdevelopinga plan for multiage» "humanistic" primary education, thereby 
leading to a gr*eat deal of mter*est in the TitI III classroom organization project we 
visited In another state, the SEA announced that individu dized instruction should 



' <ll,tsrr\ uuik on the diHu-^iwn ot iiuio^ation^ in tin* «in\t kA mental lualth su[)p<)tts the hUKKt"^ti()n 
til. it diffu^joi' is more rlh'ttur u hen iiiss<»r^iinat()J ^ no to ihc .uioptt'r Mtl\rr than \ iu' \ri>a tKduatd M 
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be stressed, which prompted other districts to ask for help from the Title 111 class- 
room oi.^anizati^)n project. The availability offunds for career education projects led 
to a receptivp audience for disseminalion'teams from two career education projects 
This kind of mtere^t. stimulated by the availability of targeted funds or new state 
guidelines, doesn't offer much guidance about how Dest to promote local interest and 
demand for new practices in the absence of such external incentives. 
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V. IMPLEMENTATION OF CHANGE AGENT PROGRAMS 
BY STATE AND FEDERAL AGENCIES 



In tho preceding bectionb we have examined the factors which seemed to infiu- 
ence the development and outcome of change agent projects In that analysis we 
concentrated on those factors inherent in the nature of the innovation itself, the 
im]>lementation strateg>, or the characteristics of the institutional setting in u hich 
it was being implenentod. In addition, we were also interested in determining the 
extent to which th^ characteristics of the federal chnnge ag'.Mit programs also have 
an efiect on tlie nature and the quality of local projects. The four programs we 
studied have different management strategies and substantive concerns. Nonethe- 
less, these federal programs have a common purpose — the stimulation of innovation 
—and a common policy instrument—the provision of temporary seed money. Thus 
the\ present an opportunitv to examine the difreientiaLeffects of different ferderal 
program strategies. 

Any change agent program can be described m large part by six factors, each 
reflecting the basic theory of change on which the program has been designed The 
first IS the scope or goal of the program. Is it supposed to bring about general 
miprovement in the quality of education <Title III), or only to improve instruction 
in particular areas (reading, career education), oronFy for a particular target group 
ibilinguah? 

The second element is the locus of authority to conduct the program. Will * he 
directed bv a federal authority or will it be i un by the states? These two factors afiec* 
the general patter^ of the program. The next four elements are o^n^ously deter- 
mined by the operating authority. 

What criteria will be used to select projects or project sites'^ Will selection be 
based on need or quality of the proposed projects'* Or will some geographic distribu- 
tion formula be used? 

Next, what type of management process will be required by the program? Some 
programs, such as Title VII. do not require a standard management approach. 
Within the Right-To-Read demonstration project, and to a lesser extent Title III, the 
districts that aie funded are expected to follow a specified management approach 
Next, how intensively will the funding authority monitor project results, and what , 
powei will tliat agency have to affect the project once it has been implemented? 

5 KinallN. what type of support will the program [provide to the adopting.districts. 
>*;^peciallv in the way of technical a.ssistance or dissemination of project results* 

Thij^ section gives a summary of the evidence we collected on how these federal 
program.^ were actually carried out, and d^•^crlbes the effects of differences in pro- 
gram a[)proaches in the award, design, or success ol t he projects they supported. Tlie 
mat(»rial in this section is based on several sources: 

1 . We collected information on the design or management of the four federal 
progiams by examining files and documents from each federal program 
ofiice and by interviewing the .staff who planned and managed the pro- 
urams ^ 

e 
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2 We collected data. on SKA roles in these proRram> hy two methods first, 
telephone interviews with SKA prot^ram managers for each federal |)ro- 
^vi\m in the 18 states ihat we selected for our .national change agent 
sample. >vcond, personal interview\s were conducted in 9 of those states 
that were chosen for differences in theit managcHiient styles so that we 
could further explore similarities and differences in SEA approaches 

3 During the course of Rnnd work at the LP'A level, both in our survey of 
293 change agent projects and our intensive iieldwork at 29 proiect sites, 
we collected information about the role of federal or state program officials 
at the project level 

In discu>sing these issues, we w ill focus primarily on the operation of the state Title 
I!! piogram, both becaube it represents the most actively managed program and 
because it constitutes the largest portion of our sample. The other programs will be 
relet red to a> thev difler from our findings about Title III. For those readers who are 
inteie.^ted in a more detailed examination of an> one particular program. Appen- 
dixes A through D to this volume contain documentation on federal and state 
implementation of each of the four programs of concern to this study. 



LOCUS OF POWER 

Kighty-fi\e percent of the fund.s available through title HI are distributed to the 
states on a proportionate basis. The state education agencies, in turn, exercise 
complete control over the use and direction of these funds under federal guidelines 
In Vocational Education. Part D. fuuds.arv provided to the states in a similai 
manner, half of the funds go to the state while half are administered directly by the 
Office of Kducation. For the remaining 15 percent of Title III. for half of Vocational 
Education. Part D. for all of thC^ bilingual funds under Title VII. and for all of the 
Right-To-Reod demon.-^tration site funds, administration and control are vested 
within the program olllces of the Office of Flducation in Washington. D.C 

These latter programs are sometimes described as if the state? could play an 
aane advisory role, but our interviews showeci little evidence of this.^ SEA officials 
claimed that federal program oiljces seldom take the advice of those state personnel 
who take the trouble to give it In fact, the state personnel who have attempted to 
exert some influence over federal programs have generally b^^en frustrated. By and 
large, we found that the state education agencies tended to ignore the operations of 
the federally run programs, often the\ ignored even projects carried out within their 
own states 



PROGRAM GOALS 

Title III has the broadest of all the program goals to allow local schools to try 
out new ideas that normall\ could not l)e put into operation becaUse of financial or 

!\'mf]t- fo-Krad alM) uiant^ iiind- to SK \^ tn v<iM(kut ti.unmt.' pio^iians^ f<»f s(h<)<>l (h^tricts. m 
unpioM-nu'iit of nMdiiuJ proi^ianis 

' in cueer ediKation (cdcral ofljci.iisMtMi) to liau' iin^'^ti'd LtMisidtM.thU' cHort in Lnuiim^^ \hv SKAs 
vMth no M^il)!(* Inflect on ihe Ux.il Hi^tricf^ 't^^ 
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olluM consliaml.s. Mo.sl .slalom IoIIoukI tin* sami* criti^non. although a few [)laced 
special oonsliainl.s on the um' of the funds, huch a> m|Ui!enu*nt.s that llu\v be used 
onl\ in pio.uranis focUhed on ba.sic hkdls. Other .slate> occasionally desi^Mialed special 
priorities in an attfiiipt to lbcu> proposals on particulai problems, but these priori- 
ties \\ei*e usualK ncTf nlan(^ator•y conditions ofawar-ds. 

Wational Kducation. Pai*t I), funds ar-e to be used exclusively for* the support 
ol'caieei education projects that caii help'ci'eate a brid^a* between school and the 
earning of a living Title X'lTfocuses exclusi\cl\ on [)rwiding conipensatoiy support 
in both languages to bilingual students, and also provides some services to students 
who come IVorn an P"nglii»h-speaking backgr'ourid Finall> .the Right-To-Read demon- 
.^nation hites focus exclusively on projects designed toenhance reading acliievement 
m large city schools 



PROJECT GENERATION AND SELECTION 

State Title III pr*ogranis followed nior-e conipr'ehensive pr-oject gener-ation and 
selection pr'ocedurvs than did the other change agent pr^ograrns. The basic pr-ocedure 
foi ^selecting pr*ojects was essentialK the same across the states. The sequence usu- 
ally began when the SEA notified its LEAs of the availability-of Title III funds 
During the fall a pr*ogr*am announcement was yent out by the Chief State School 
OHicer to each of tlie local districts This announcement solicited proposals and 
explained the basic gr*ound rules for funding projects. It also announced any special 
prioritK ^ which the state may have chosen to follow. This announcement sometimes 
wa.s followed up by talks ar*ound the state given by Title III per-sonnel. or by work- 
.shop^ designed to encourage submission of proposals bv those districts that had not 
yet done so 

interested LEAs responded with a letter of interest or a pr'eliminar-y proposal, 
norniall\ running two to five pages, which de.scribed the pi'oposed Title III project. 
These [)reliminar-v pro[)osals wer-e then scr*eened by a r*eview panel, which usually 
consisted of both SKA ^onnel and an outside citi/.i . ad\ isor-y panel. The pr'oposals 
were then graded, 1 on both the cjuality of the proposed pi'oject and any priori- 
ties that the state h.. lectcd to follow^ Some of the LEAs wa^'e then r'equested to 
.submit for mal proposals The.se wei*e sometime^ restricted to those who scored high 
est in the proposal ranking, or the "finalists" sometimes also r'efiected political or 
geoc^Mf^hic di.stnbution consider-ations. No state appeared to allow all of its pi-ojects 
to cluster in.a few continuously successful districts But neither did most slates 
neglect to fund some pr'oject.s in their lar*ge metropolitan districts, regai'dless of the 
(|ualit> of their [)roposals 

Piepar-ation of the full-blow ri proposal normallv involved some negotiation be- 
tween the LEA and the state S[)ecial worksho[)s wer*e oflen held to assist in this 
pio[)o.sal [)reparation, hi most cases the LEAs preparing pr-oposals wer e assured that 
the grant would eventuall\ be received. These final propo.sals wei*c then submitted 
auam to the state's review panel for administrative a[)pr-oval The grants wer*e then 
awar-ded \ the Chief State School Officor's final cori.sent 

Some si made special efforts to encourage proposals from districts that wer*e 
reluctant to inno\att' These efl'oi t^ included such devices as pro\ ision of a simplified 
standard foimat for propo.sai preparation, or completel\ piickaged project models 
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uliK-li a district could simply adopt ofl'tho shelf States tliat did tlii.s tended to see 
then pnman role in the pio^ram a.s K^ttinii all ofthe LKAs to participate, re^^ird- 
loss of the changes eventuallv accomplished 

The allocation of state funds for Vocatioiral Kducation. Part D. worked e.ssen- 
tiallv the same \va\. However, since the basic need for the funds was assumed, less 
effort had to be devoted toju^tifving the project than under Title III Also, many of 
the SK.As devoted more attentu.n to providing technical assistance for career educa- 
tion proposals, in the form of checklists or packaged approaches, than they did in 
Title III. 

In all ofthe fWerally admini.stered programs, projects rejected the recommen- 
dations of the SEA to some degree. The Right-To-Read project selection was the 
major exception to this general rule The large city projects in our study were 
nominated for inclusion in the program b\ the district superintendent or an SEA 
oflicial. and were not based on proposals. Schools were selected from the list without 
any initial commitment to the objectives of Right-To-Read or any specific project 
a'^proach 

The result of the.^e somewhat dijlerent project selection processes was that state 
projects, which were more competitively awarded, tended to be more consistently 
devoted to the expressed objectives ofthe program. Federally selected projects, on 
the othe- hand, tended to be characterized by "financial opportunism," in that the 
LKA seldom had to expend any great effort to be awarded the grant. 



PROJECT MONITORING 

Some SEAs monitored Title III projects carefully, and all projects wore required 
to have an evaluation component. It could consist of evaluation by some member of 
the local staff, by an outside consultant, or by somebody selected by the state. The 
Mate project officer usually visited the project once or twice a year, in addition to 
reviewing all the project documents. Sometimes the state differentiated between 
project consultants, who provided technical assistance to the local districts, and 
program evaluators. who played a more independent evaluativ^e role. 

The impact of any state project monitor was largely determined by his own 
skills and personality. Those who wanted to take the time could force an LEA to 
consider an> of their reasonable objectionssirnply by delaying approval on the many 
program documents that were required. None of the states we visited had any formal 
s>stem for relating the program evaluations to subsequent funding decisions In fact, 
the project funds were seldom terminated for misuse of program funds or obviously 
ineffective projec* activities or management strategies. 

SEA career education program managers also tended to visit their projects 
'f hev were much more likely to have a substantive viewpoint about how the project 
should be run than their 'fitle III counterparts, because they usually had a back- 
ground in that field and because they usually participated in developing some ofthe 
state's packaged materials. 

Monitoring of projects in federally managed programs was much more passive 
The federally run Part D program decided that the only role ofthe project monitor 
should he to ensure^hat the project followed its plan The monitor was not to get 
involved in discussing potential changes in the operating plan 

71- 
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III Title \'il the piou^ram stall' was >o small in comparison to the [)mject work- 
load tlial >'nv \ \>\{> could oid\ be done iiu risks situations Title VW had no formal 
>trate^\ Ibi [)ro\!dina regular or svstematic technical assistance, and the only 
eflo!l> m tliat linection ueie a feu sporadic conference.s which some ofthe [)r()ject 
staff" atiended Tlie Title \M1 staffs role was to assist the local project people in 
interpreting^ ^mkI working within the le^al and budgetar\ requiiements of* their 
pro<^Mam 

Kight-To-Read had a small staff, and program oflicials were only able to monitor 
then demonstration site [)rojects during their first >ear To pro\ide some technical 
a.^si.stance. the program established four university-ba.sed consulting groups which 
were available to visit siie^; and answer specific technical questions. 

in a few states where there was particular concern with a given problem, the 
SKi\ took up bome of the slack lefl b\ the absence of federal project management, 
in a few states with large bilingual populations, for example, the SEA developed its 
own bilingual staff, which was available to provide program guidance and cur- 
i iculum materials foi federall\ funded programs, in most states theSfilA had its own 
reading initiative m addition to the Right-To-Read demonstration sites The Right- 
To-Read funds which were directly available to the SEt\ were used to support these 
[)rograms. On the other hand, the SKAs did not make much use of the federally 
funded Right-To-Read demonstration sites as models for ntwv practices. 



EVALUATION AND DISSEMINATION OF PROJECT RESULTS 

Onl\ in the state Title III programs were annual evaluations used to make any 
modifications in project design/ Although thequality ofevaluation varied consider- 
ably from project to project, a number of sound project evaluations were observed. 
The.se usuall> involved complete descriptions of the implementation process, as well 
as of the project results In a few cases projects were primarily aimed at dissemina- 
tion of activities to other districts.* However, we found few cases where the SEA 
directlv disseminated local projects to other districts in the state. Almost all the 
dissemination that did take [)lace was done at the LEA's initiative, or*, in the case 
o^ natiunall) validated Title 111 projects, with Title 111 funds specifically allocated 
for that purpose 



SUMMARY 

After observing the.se programs in [)ractice. it appeal's to us that the federally 
run program.s were generallv le.ss eflective than tliose oper*ated by the states. P^r'st. 
those federal [)r'ojects which were selected by nomination, rather than b> competi- 
tive propo.sal.s. suffered coriMstentlv from the lack of'commitment bv the local dis- 
trict administration. 1 ne.se project.^ were less likdy to have successful outcomes. 
(»ven tliough they wer*e likely to be le.ss ambitious from the start 

I lujcj lf)i* fj'dcr.i! \<M <iti<>n.»l Ivliii.itlun piu^f^rn uhuh rctjiHr**^} tlnni {>.jrt\ cx.tlu.itiorts iut .tH 



63 



Strumi, federal prounam management lacked significant monitoring, which led 
man\ lecipient LKA^ nut to take fedeial objectives seriously. Projects which were 
dowels monitored b\ the fluiding authorities usually achieved more attention from 
local participants 

Third. methodologicall\ sound or comprehensive project evaluations were only 
obtained in those cases where the evaluation plan was bahed on detailed negotiation 
with the monitoring ofhcials. Thib occurred on!y in state-run programs. Evaluations 
which were performed in response to written program guidelines generally were 
almost useless and lacked scientific rigor / 

Fourth, the federally sponsored projects we observed never achieved anywhere 
near the exemplary status they were designed to. and were typically ignored by the 
SKAs. The states seemed to take absolutely no interest in the outcomes of these 
projects or in their ability to servt- as "moder* programs. 



VL SUMMARY OF FINDINGS 



The preceding sectionb described the central elements ofthe process ofchange 
that characterized the projects we visited, and pur assessment ofthe major differ- 
ences in the four change agent program management strategies. This section 
presents a summary ofthe major findings reported in each section. 

INITIATION 

A broad hypothesis generated by the conceptual frame\ ork described in Vol. I 
is that district-level support and commitment underlying project initiation affect 
project implementation and outcomes. Our fieldwork provided strong support for 
that hypothesis. 

Our most general finding was that the initiation process was characterized to 
a greater or lesser extent by two "models" of adoption: opportunism and problem- 
solving. That is, most districts initiated federal change agent projects primarily 
either because the money was available, or as a solution to a specified local need. 
In only a few instances were projects suggested by new information or outside 
change agents (n.b, "social interaction" and "linkage" models ofchange). None of 
the projects we observed evidenced an R&D, experimental, or even quasi-experimen- 
tal approach to change. 

The projects that were characterized by simple opportunity-based behavior also 
generally lacked the commitment and support of local district administrators. In the 
projects we observed, this support was not subsequently generated during project 
implementation— despite project accomplishments. The frequent result of this lack 
of district-level support and commitment was that the project staff failed to take the 
project goals and objectives seriously, morale suffered, implementation floundered, 
and significant change seldom occurred. 

Projects that were initiated primarily as a response to a local need, on the other 
hand, were usually characterized by a high level of district support and interest. 
This commitment gave the project status in the eyes of participants and helped staff 
weather the rough first year or so of implementing significant change in traditional 
practices. 

Other specific findings concerning the initiation process were related to this 
general finding and its importance for district commitment: 

• Projects that weie initiated because of a specified local educational need 
were the most successfully implemented and led to the most change in 
district practices. 

• Projects that addressed goals that the LEA perceived as centra* "'^re more 
likely to result m significant change than projects undertaken to satisfy 
some less central local or federal concern. 

• Change agent projects were usually designed utilizing information or 
treatments that were already known locaSly, rather than employing infor- 
mation gathered in a search for^^^native practices 
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Projects that involved btaff* responsible for project implementation in 
project development usually h.id less trouble with implementation 
l^rojects desi^Mied In "outside experts" i^enerally failed to ^^ather the su[)- 
port of LKA participants or achieve their objectnes 



IMPLEMENTATION 

The two^^cneral hypothes(»s ^u^^^^'^ted by our conceptual framework— that in- 
novation is essentially a process of mutual adaptation, and that implementation 
strategies will significantly affect project outcomes— were supported by our field 
observations. We found that where .significant change occurred in district practices, 
project implementation was characterized by adaptation m the initial project desi^Mi 
over time and by modification or change m the institutional settingand its members 

Similarly, the characteristics of the innovative [)roject that we found to be most 
consistentl\ and significantly related to successful implementation and change were 
thobe implementation strategies that fostered mutual adaptation and permitted it 
to take place. Specifically: 

• Successful project imi)lementation was found to be related to the /vpc. not 
to the amount of project planning. ■"On-hne" project planning that was an 
ongoing process permitting frequent reassessment of project methods and 
goals was found to be the most effective. 

• The moretraininggiven project staff, the better. Pre-service training, com- 
bined with in-service training, was found to be particularly im|)ortanl to 
projects expecting staff to implement the far-reaching changes embodied in 
projects such as the classroom organization projects. 

• The most effective training took the form of very cr -rete "how-to-do-it" 
workshops given by local personnel. Outside technioa. .sistants were gen- 
erally not effective in the training role. 

• Frequent, regular meetings of project personnel facilitated project im- 
plementation. They provided a forum for discussing project problems, shar- 
ing ideas, and promoting staff morale. 

• The local development of project mat^M'ials. as opposed to the utilization 
of commercially prepared systems, appeared to contribute to project im- 
plementation and the amount of change achieved. Local development pro- 
vided an opportunity for "learning by doing" as well as a sense of identifica- 
tion with, project goals and more thorough understanding of precepts. 

• Intangible professional or psychological incentives were more effective in 
- * soliciting teacher cooperation and involvement than were more tangible 

incentives such as extra .pay. credit on the district salary scak\ and the like 
Simihirly. projects staffed by volunteeis were more likely to be succes-sfully 
implemented. 

. Klementary school projects were typically more successful than high 

school or junior high school projects. 
. Project success was more likely where participants formed a sufficiently 

large group Ui "critical mas^") to provide mutual support and share ideas 

• District and project personnel experience with innovation generally and- 
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or with the specific new practice to be implemented facilitated project^ 
implementation. 

• The existence of other innovative projects in the district sometimes de- 
tracted from the attention paid a ijiven project and thus its chances of 
success. 

• Strong administrative support from all levels ofthe system appeared to be 
essential to successful project implementation. 

• A flexible administrative approach and open communication channels 
were typical of projects that were able to deal effectively with the unan- 
ticipated events that occurred in the course of an innovation. 

• Significant classroom changes were more likely to occur when staff were 
provided with ongoingadministrative or technical help from local resource 
people that complemented the training or materials development phases 
of the project. 



PROJECT OUTCOMES 

The fbllowmg project effects on classrooms, teachers, and students were noted: 

• Staff development and classroom organi7,ation projects had a greater im- 
pact on the atmosphere and activities ofthe classroom than did the more 
narrowly focused change agent projects. 

• <1assroom effects were greater in the lower grades. 

• Change in one part of the curriculum — such as reading or career education 
—seldom affected other parts, even when subjects were taught by the same 
teacher. ^ 

• Classroom organization and staff development projects resulted in the 
most significant and pervasive changes in teacher behavior and attitudes. 

We found that among those projects for which evaluation reports were available the 
results seldom showed significant gains in student achievement scores. Some pro- 
Ject.s, particularly the classroom organization projects, did report improvements in 
student attendance, school-related attitudesrselfcontrol, and confidence 

Continuation 

One hypothesis suggested by the theoretical framework is that continuation 
decisions will not be made on the basis of project merit alone, but will include 
considerations related to the political economy ofthe institutional setting as well. 
Our fieldwork provided some evidence to support this hypothesis We found that 
project evaluations did not generally play an important role in local decisions to 
continue or terminate change agent practices, hi fact, we observed that some pur- 
portedly "succcssfur' projects were to be discontinued by the district, while projects 
that had demonstrated no clear relative advantage were expected to be continued 
afler the withdrawal of federal funds. These decisions were primarily a reflection 
of dii?trict-level inteivst in pursuing the project per se, or more tangential political 
concerns. 

In addition, we found: 



67 

• Projects that attcMiipted-to ivplave existing, practices were more likely to 
be continued than those which merelv supph>nwnted the existing cur- 
riculum. 

• Projects that emphai,i/ed stafrtraining (as opposed to the introduction of 
new technologies) appeared to have the most lasting and continuing effect 
on teacher practices. 

• Tr^ning tied to ongoing classroom practice tended to have a more perva- 
sive efiect than training not explicitly related to a teachers day-to-day 
responsibilities. 

• Decisions about project continuation appeared to parallel closely the moti- 
vations to initiate the project Projects that were initiated with strong 
district support and that were seen as a solution to a particular problem 
were expected to be continued without exception. Conversely, those pro- 
jects that represented an opportunistic response and received little or no 
support from district administrators typically were expected to wither 
away, even when project objectives were met, 

• Projects that were primarily designed or stalled by outsiders (such as con- 
sultants or special teachers) were usually not expected to be continued or 

. incorporated. 

Dissemination 

Only a few of the change agent projects we visited were actively or explicitly 
engaged in project dissemination activities The following tentative and preliminary 
findings concerning intra- and inter-district dissemination emerged from our field- 
work: 

• Lack of "demand^^ rather than inadequate or unavaihible information 
seemed to account for the low level of* interest in change agent project 
practices and materials. 

• Theve was little "lighthouse** effect of change agent projects within the 
host district: project impact was rarely seen beyond participating schools. 

• Dissemination efforts appeared to be more productive where they helped 
other districts build their own innovative capacities rather than attempt- 
ing to replicate a specific model. 

IMPLEMENTATION OF CHANGE AGENT PROGRAMS BY 
STATE AND FEDERAL AGENCIES 

• State-administered change agent programs were generally better imple- 
mented and conformed more closely to proposed project objectives. 

• Federally run demonstration projects were frequently igno^ed by SEA 
officials. 

• Competitively awarded projects appeared more likdy to he successful than 
tho.se funded by nomination. 

• Elvaluations performed in response to change agent program guidelines 
were rarelv used to modify project design or operation. 

SO 
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• Monitorliig of federally administered projects was much more passive and 
infrequent than monitorinKM)f\state-run programs. 

In conclusion, we would like to remind the reader ofthe limitations outlined in the 
introduction to this volume These findings are interim and must be viewed as 
preliminary. They will serve to generate hypotheses, that will be explored in the 
second phase of this study. We expect that the findings presented here will be 
s^ubsequently refined and integrated with our quantitative work as our research 
proceeds. 
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Annex A 



RESEARCH GUIDE FOR FIELD DATA COLLECTION AND 

REPORTING 



The following guide is intended to assist the researcher in collecting and report- 
ing field data. It expands on the conceptual summarv ofHhe change agent stud> and 
indicates what topics, components, and indicators to consider for each of the major 
concepts, initiation, current operations, original implementation, adaptation, near- 
term behavioral change, continuation, and dissemmation/diflusion. 

The guide is not intended to be used as an uiterview schedule, although the user 
may choose to follow its sequence. Interviewing styles and circumstances should 
dictate how data are gathered. Used as a checklist of topics or items, the guide can 
remind the user of information to be obtained. 

The guide should be used as an outline for all project-site field reports. General- 
ly, there are two forms of field data- (Da raw file of narrative or discussion material, 
often organized by daily field experiences; and (2la field report that organizes these 
data according to the following outline. 

INITIATION' 

Reason for mitiation of project 

Source of idea 

• Author of idea (by position) 

• Proponent of idea (by position) 

Extension of a practice already in place in this site 

Alternatives 

• Were they considered? What were they? 

Proposal activities 

• What people (by position) wTote rt*-^ 

• What people were involved'^ 

• Whose ideas were considered in writing it? 

• Where did it go? (Trace offices) 

Funding and grant negotiations 
Planning 

• What was the process of planning? 

• What people were involved? 

• What were the major issues? 

' ThvM' tiH» pn>)t'k t sitv piuMionuMia K anv cori^)()iu'nt doo> not fit the particular ciicumstancc you 
.tie (lescribiim. omit that (.ompoiicnt For vxaniplt'. ^vhtTc thfcvnlruloiria' unilaterallv imposed a project 
on a vschooi. several ol Miese rnitration oomf)()nt»nts will not apply 
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S(»h'cti()n of [)ai lici|)atin.u ^'1"^^'^*^ and or teachers 
. Who did It*' 

• On wl'iat basis'' • , 

. Which of the follovMn^ activities, <icti'all\ involved pfM)ple from this project 
site' 

— Ahernatives 

— Proposal activi'je-^ 

— Planning 

— Selection 

Support /Opposition 

. Identify by position the proponents and opponents of" Initiating this project 
in this school. 

Characterization of the initiation proces^^ 

• Which, if* any. of the fbllo viug models could fairly be said to describe the 
initiation process for this i- /ation? 

— Model A: - "Probler /R&D process' 

• Rational seque^ ^ ^eds assessment, goal setting, aiternatives. 
planning, etc. ' i..- .ncludes responses to community, teacher, or 
economic pressures. Identify source of felt need. 

— iModol B: "Linkage" 

. Model A assistance from SEA. universities, or other external re- 
sources. 

— Model C: "Opportunistic response to avaihible money" 

. Goals and treatments adjusted to means; some of local needs 
lectod to qualify for available support. 

Brief description of what happened in the initiation process • 

Baseline characteristics of the organization prior to implementation 

• Size 

• Age and condition of facilities 

• Per pupil expenditure 

• Racial and socioeconomic composition 

• Thief u.se of extra funds (additional personnel, activities, extra equipment, 
facilities?) 

• Pupil/teacher ratio 

. Staff turnover (percent of total staff turnover for most recent year) 

• StaiT age patterns 

• Dropout/push-out rate 

• Number entering college ^ 

• Number of other "speciar' or discretionary programs j their funds and/or 
staff size 

S3 
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CURRENT OPERATIONS 

Part A: Characteristics of the Project 

Cruab and objectives 

• Clarity, comprehensivenesb. onj^in, etc. 

Goal centrality ' 

• How important are the project s goals compared to the school's most impor- 
tant pre-existing goals? 

Goal consonance 

• Are the project s goals new to the school or something akays thought impor- 
tant? 

Treatment or means 

» Is the project strategy appropriate? 

. Which ofthe following four major types of'treatment received more empha- 
sis? 

• What was their comparative utility? 

— Materials 

>^ • Curriculum materials; from inside or outside schcol, etc. 

• Testing procedures, placement procedures, etc. 

• "Packaged" pedagogical techniques, e.g , teaching guides with lots 
of supporting materials 

— Classroom organization 

— Staff development 

• Target group, freq: »ncy. duration, kind. etc. 

— Additional personnel 

Management 

• .Administrative organization in school 

• Administrative relations beyond school 

• Resource allocation decisions (who. on what grounds, etc.) 

• Planning (how extensive, who paKt^!fpates, etc.) 

• Involvement of target groups in management decisions 

• Involvement of administration in project activities 
Evaluation (formative and summative). Who does it? How? 

Complexity of project 

• Number and frequency of contingent events 

• Length of necessary sequences 

• Extent of cooperation required from different units 

Amount of special training required 

Amount of change required 

• To be successful, how radically does the school have to depart iVom past 
practices? Or is change only incremental, or is no change required? 
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Kxtent of'chaiif^^e required 

• A< a percent oi'tlie scliuolV total stall', how many people ha\e to change in 
order lo make the project succes>fur^ 

I'lace wliere chmge is to be nmnifbst 

• On site of project or away? 

Part B: Organizational and Personal Characteristics of the School Site 

Organi/ati^jnal components 

• Amount of bureaucratization , 

— Hierarchies and chains of command enforced? 

— Emphasis on position more than performance? 

— Standard operating procedures (mucli or little flexibility'^) 

• Informal versus formal communications 

— Amount and way in which interpersonal comnuinications bypass and/ 
or supplemcMit formal organizational structure 

• Participation in decisions a^)Out project 

— Amount of participation (by positions) ^ ^ \ - 

— Amount of participation (by proceh stage of the decision, e.g.-. i>lanning. 
allocating resources, evaluating. etcJ 

• Organizational capacity to innovate •* 

— Amount and extent of prior innovations 

— Pressure of people interested in or specializing in innovation 

— Would tfiey feel free to take on a project that might have a big payoff 
but a low probability of succeeding? 

Personal components 

• Ancillary effects on project participants 

— Direct incentives during project (salary, released time, status, etc.) 

— Credential, certificate, license 

— Promotion 

— More '/iesirnble assignment 

— Greater mobility or visibility 

— Increased responsibility 

— Satisfactions intrinsic to role performance 

• Role-correlates ofj chief participants^ 

-- Administrators 

• Education (level, place, and type) 

• Age (estimat'O 

• Tenure 

• Previous pn^itjon 

• Amount of experience with previous innovative projects 

• Ambition (what kind of job do you .^ee yourself having in 5 years?) 

An .idtHjUtiK^ th.ii.K't(*M/,itioii o( \ school .is «i site for itifun.ilioii tmist n-toul >on)(> hrli.iMur.d 
ioncLites Thvs(« should, xshcrcxcr po^si[,|<.. hcdot ufucr^tcii OnK one p.iU(> vsoulil h<' usrd .is • ^uidc lor 
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• How selected for project 

« Awareness of 'policy" issues around this project 
. C'areer-bound/plaee-bound Hvould you accept a promotion t a bet- 
ter job in another part of the country''^) 
. Amount of salary j*oceived from project funds (soil money) 

• Number of pr8mo^ioi>t5 associated with project experience 
. Amount and type of project specific training received 

• Percent of time devoted to project 

Project director on site (leader, chief teachers, etc > 

• Education (level, place, and type) 

• Age (estimate) 

• Tenure 

• Previous position 

• Amount of experience with previous innovative projects 

. Ambit'on (what kind of job do you see yourself having in 5 years?) 

• How selected for project 

• Awareness of ''policy'' issues around this proji-ct 

. Career-bound/place-bound (would you accept a promotion to a bet- 
ter job in another part of the country?) 
. Amount of salary received'from project fufids (soil money) 
. iNumber of promotions associated with project experience . 
. Amount and type of project specific training received 

• Percent of time devoted to project 

Teachers 

• Age (estimate) 

. Previous experience (general; specifically with innovative prac- 
tices) 

• Training 

• TenuredAiot; length of tin;e in this school 

. Career-bound/place-bound (would you accept a promotion to a bet- 
ter job in another part of the country'^) 
. Amount of salary received from project funds (sofl money) 
. Number of promotions associated with project experience 

• Flow selected for project 

• Amount and type of project-related training 

• Percent of time devoted to project 

Paraprofessionals 

. Amount of salary from this project (sof\ money) 

• Background (socioeconomic status) 

• Prt^'ious association with the school 

• How selected 

« Amount and type of project-related training 

Volunteers 

« How selected 

• Background (socioeconomic status) 

. Amount and type of project-related training 
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ORIGINAL IMPLEMENTATION 

Tin* j)iH()o.^c' of Ihih .section i^ to recoid the feature^ oftlio project tlun wmo 
initial!\ |)ut in place. Tlie tune period ibr or iginal implementation mav be con.^id- 
ered as being within the first 90 da>h or the first one-cjuarter of tlie project's life. 
Tliese original features of the project may be recorded by referring to tlie major 
Mi(»adings from the "Current Operations" section. 

Part A: Chari>cteristics of the Project (as it was originally implemented) , 

(loals and objectives * • - ' 

• Centrality 

• Consonance 

Treatment or means 

• Materials 

• Classroom organization 

• Staff development 

• Additional personnel 

Kn\phasis among types of treatment 
Comparative utility of types of treatnuMit 
Management cliaracteristics 
Complexity of project 
Amount and extent of change required 
Place where change was to occur 

Part B: Organizational and P^r5?onaI Characteristics of the School Site 

• Organizational components 

• Amount of bureaucratization 

• Informal vei:sus formal communications 

• Participation in decisions about project 

• Organizational capacity to innovate 

• ^ ^ * 

l^»r^()nal components 

• Ancillary effects on the fbllowing project participants (incentives, etc ) 

— Administrators 

— Project directors 

— Teachers 

^ — Paraprofessionals 

— Volunteers 

• Kor any of the major groups of participants, what \vas tlie original situation 
With respect to the important role correlates which could be expected to 
change as a function of the project'^ 

. ~ Career-bound/place-bound 

— Promotions 

— Amount of training * 
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ADAPTATIONS 

Tlii> ^^ection repeats the format of the i)reviou^ two section^ and asks you to 
record any chan^a»s between the project ai> it was ori^Mnallv implemented and as it 
IS now. Bneflv record what changes wore made and the reasons for those changes 

Part A: Characteristics of the Project 
Cioals and objectives 
Treatment or means' 

Kmphasis among types of treatment ... 

Comparative utility of types of treatment 

Management characteristics 

('omplexity of project 

Amount an3 extent of change required 

Place where change was to occur < 



Modiljcatton- M.»(i<' 









Part B: Organizational, and Personal Characteristics 

Organizational tomponents 

• Amount of bureaucratization 

• hifbrmal versus formal ccmmunications 

• Participation in decisions about project 

• Organizational capacity to innovate 

l^'rsonal components 

• Ancillary ei.jcts on the following project participants: 

— Administrators 

— Project directors 

— Teacher. 

— Others 

' ^Mvo particular .U(<'nli<>n to adaptation^ in this ('at(*u<>r\ 

^8 
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• Role correlates of chief participants 
Career-boiUid place-hound 

— I^roniotions 

— Amoun; of training 



NEAR-TERM BEHAVIORAL CHANGE* 

Organizational changes'* 

• Support for school or unit 

• Morale 

• Other 

Behavioral changes in school personnel 

• Areas of change aff^^cted 

• Teacher learning changes unaccompanied by education achievement 
changes 

• Centrahtv of area of change affected for school (changes affecting high pnori- 
ly activities) 

• Centrality of area of change affected for the person v " 

• Distribution of that change (proportion of people so affectedJ 

• Acquisition of new teaching skills 

Changes in students 
' • Increased educational achievement 

— By grade (proportion of target group affected, document where possible) 

— By learning-related characteristics (pr^poriion; document) 

• Other education-related changes in students 

— Sense of fate cpntroMproportion; document) 

— Amoitnt of participation (proportion; docuiient) 

— Attitude to school as institution (proportion; document) 

— Attitude to school personnehproportion; documc^nt ) 

— Attendance 

' Outionu's of pioH'Ot trcntm^^n! (kuu m'*! dm inn tfu^ ol piojctts 

Ahhoimh the Uhw^ is on Ix'havioral ch.jnuc tl^oM'ouMniAilmn.tl li.iimcs vshkh hisi- \vd lo hvh,i\ 
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Valuo of project to administrators 

• Area of change adected 

• Would thoy do it a^^ain*^ 
« Current priority ranking 

• Hooomniend for others*^ 

Unanticipated consequences 
Negative consequences 

CONTINUATION 

These components indicate the changes that survive the end of the innovation 
attempt. They are longer term than the changes discussed earlier P'or projects 
which are still in progress, this will be an estimate. 

Refer to "Current Operations, Part A. Characteristics of the Project." Record 
any features that have persisted or that you expect to persist. This judgment should 
be made with respect to the specific features of the project which you are describing 

Project technique.^' and strategy 

• Goals 

• Treatment (expand to fit your project) 



Pi<)lKi:>ir Duratiop. 
(•<>ntjn«iatu>n \<'ai' > 


Kxtcnt 0* ( ontmiuition <K\|)H'^s 
as percent of total ^^itc which 
vouid b(* expected to continue 
with project tieatment' 







DISSEMINATION/DHTUSION 

This section concrrnr the exporting of behavioral, structural, material, or tech- 
nological change fro.n the original place of the change to other places. Refer again 
to ''Current Operations, Part A: Characteristics of the Project." Record any of those 
characteristics that you have reason to believe have been disseminated to another 
school or LEA from this project. 

(ioals 

Treatment 



Spinoff projects 
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1\) ll<>\% M.tiu PLut^^' 


How Will h Be Ini})ltMnriU<-(i'* 







CONCKIMl^AI. SrMMAUV 
(For HclertMU'c 



Win ar.i'l how (iid llu* school nutiatc tlu' | 
INITIATION 








Whnt .irv tlu^curunt chiuoctcrL-tic^ oi tlu 
CrKKKNT OPKKATIONS 


piojcvt*' 




What won* \Uv onuina! ciiatnctcn^^hc*- o( th 
OKKHNAI. IMPLKMKNTATION 


0 project * 



\\a\\ (h(l the schoo' M\Wi the piojcct*^ 
' ADAPTATION 



r 



How did th'* projnl aiUri tlu* nhool ' 
NKAH TKh'M HKHAVIORAI, OIIAMJK 



Wiuil charactrnstK^ ol the pio|<'(t 
an^ hkch to Im- u)n(iiuu'<l ni tfi<* 
Hchool <dU«f the nion<«\ Mops' 
CONIINl'ATION 



Wis tlu' pioj(Vt (lisM'ritihatcd to 

)thfM schools Of IJv\s'* 

DISSKM {NATION 



Annex B 



. EPRESENTATIVE BACKGROUND MATERIAL FOR A 
CLASSROOM ORGANIZATION PROJECT 



PROJECT EVALUATION. BUDGET, AND PLANNING DOCUMENTS 

• Validation report 1973 

• Superintendent's end-of-year report 1972-7:5 

• 1973-74 evaluation report 

• 1972-73 evaluation report 

• 1971-72 evaluation report 

• Proposed budget for "An Introduction to Individualized Instruction in the 
p]lenientary School" 

• Dissemination plan 

• Report on project visitations and reactions ol* visitors 

• P'inal project report. 1st drafl 1974 

• First-year evaluation— evaluating tlie open classroom (journal article by 
(irst-year project evaluator) 

• Final application FY 1971-72. 1972-73 

• Notice of allocation 

• Applicatioiv (or continuation grant 1973 

• Expenditure reports 



PROJECT-DEVELOPED MATERIALS 

Project abstracts 

• Project reading checklist 

• "Values of Learning Centers" 

• "About Criterion-Referenced Testing" 

• "Family or Vertjcal Grouping" 

• "Vertical Grouping Questions" 

• Resource materials distributed by [)roject ^.i kits) 

• "Children's Play Is the Way Children Learn" 

• Flyer describing project-produced materials 

• Primary math checklist 6, 7, 8 

« "An Introduction to hidividuah/ed Instruction" 

• Supervision and curriculum development activities descri[)tion 

• "Prescription for Learning" 

• Alternative program (secondary education) 

• "Educational Programs That Work— A Technical Brief' 

• Activity dictionary 

• 'Individual Structured Learning" 

• "Product Development Activities" 
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GENERAL DESCRIPTIVE MATERIAL 

• I^roject overview 

• The project director's subjective view on evaluating open clasi^room 

• Floorplans of participating school 

• Principal's seminar-— schedule and format 

• Report to parents 

• Newsletters 

• Kducational services for school-age parents 

• Maps of community 

• Projected new activities: 4-5. K-3. K-5 

• August workshop 1972 

• Miscellaneous correspondence 
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